[Answered] How can I use local LLM in the firefox AI chatbot (piefed.social)

submitted 3 weeks ago* (last edited 2 weeks ago) by astro_ray@piefed.social to c/firefox@lemmy.ml

2 comments fedilink hide all child comments

Today I saw the AI chatbot in the sidebar for the first time (I remember turning the setting of in the Labs settings, but they turned it on IG). Looking the options, it supports a number of models, but all of them seems to be on a remote servers. Is there any way to use an LLM run on my own machine?

you are viewing a single comment's thread
view the rest of the comments

[-] MrOtherGuy@lemmy.world 7 points 3 weeks ago

Go to about:config and set the pref browser.ml.chat.hideLocalhost to false Afterwards you can select localhost as the provider in Settings > Firefox Labs

[-] astro_ray@piefed.social 3 points 3 weeks ago

Thanks

this post was submitted on 31 Jan 2025

16 points (94.4% liked)

Firefox

18633 readers

4 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago

MODERATORS

k_o_t@lemmy.ml