670
you are viewing a single comment's thread
view the rest of the comments
[-] DarkThoughts@kbin.social 1 points 9 months ago

There's no way it would be running locally.

[-] kakes@sh.itjust.works 3 points 9 months ago

In their defense, Mozilla did create the easiest way to run and integrate an LLM locally, so if anyone could do it, I imagine it would be them.

https://github.com/Mozilla-Ocho/llamafile

[-] DarkThoughts@kbin.social 3 points 9 months ago

Yes, but what would a local model do for you in this case? Chatbots in browsers are typically used as an alternative / more contextualized search engine. For that you need proper access to an index of search results. Most people will also not have enough computing power to make use of any complex chatbot / larger context sizes.

[-] kakes@sh.itjust.works 1 points 9 months ago

Pennomi wrote a whole list of potential ideas. And honestly, while I agree that local LLMs on typical hardware are underpowered for most tasks, it's possible they would have the option for those that can run it.

People are getting all upset over this announcement without even knowing what their plan actually is, like the word "AI" is making them foam at the mouth or something. I'm just saying we should reserve judgements for when we have an idea of what's happening.

[-] DarkThoughts@kbin.social 1 points 9 months ago

And I replied to that comment, without any mouth foaming.

[-] kakes@sh.itjust.works 1 points 9 months ago

Yes, and then you asked for ideas, which were in that comment that you replied to.

[-] DarkThoughts@kbin.social 0 points 9 months ago

I honestly have no idea what you're referring to now. I never asked for any ideas.

this post was submitted on 14 Feb 2024
670 points (95.5% liked)

Technology

59670 readers
2259 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS