16
[Answered] How can I use local LLM in the firefox AI chatbot (piefed.social)
submitted 2 weeks ago* (last edited 2 weeks ago) by astro_ray@piefed.social to c/firefox@lemmy.ml
2 comments fedilink hide all child comments

Today I saw the AI chatbot in the sidebar for the first time (I remember turning the setting of in the Labs settings, but they turned it on IG). Looking the options, it supports a number of models, but all of them seems to be on a remote servers. Is there any way to use an LLM run on my own machine?

top 2 comments
sorted by: hot top controversial new old
[-] MrOtherGuy@lemmy.world 7 points 2 weeks ago

Go to about:config and set the pref browser.ml.chat.hideLocalhost to false Afterwards you can select localhost as the provider in Settings > Firefox Labs

[-] astro_ray@piefed.social 3 points 2 weeks ago

Thanks

this post was submitted on 31 Jan 2025
16 points (94.4% liked)

Firefox

18626 readers
71 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago
MODERATORS
k_o_t@lemmy.ml