1911
The dream (lemmy.world)
submitted 1 year ago by Stamets@lemmy.world to c/whitepeopletwitter@sh.itjust.works
251 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[-] CeeBee@lemmy.world 2 points 1 year ago

I don't know of an LLM that works decently on personal hardware

Ollama with ollama-webui. Models like solar-10.7b and mistral-7b work nicely on local hardware. Solar 10.7b should work well on a card with 8GB of vram.

[-] ParetoOptimalDev@lemmy.today 1 points 11 months ago

If you have really low specs use the recently open sourced Microsoft Phi model.

this post was submitted on 25 Dec 2023
1911 points (97.8% liked)

People Twitter

5383 readers
1170 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

  1. Mark NSFW content.
  2. No doxxing people.
  3. Must be a tweet or similar
  4. No bullying or international politcs
  5. Be excellent to each other.
  6. Provide an archived link to the tweet (or similar) being shown if it's a major figure or a politician.

founded 2 years ago
MODERATORS
SendMeYourTaTas@sh.itjust.works
pelespirit@sh.itjust.works