[April 2025] Which model are you using? (aussie.zone)

submitted 2 weeks ago by Eyekaytee@aussie.zone to c/localllama@sh.itjust.works

13 comments fedilink hide all child comments

Just thinking about making this a monthly post, which model are you using? what are the positives and negatives?

you are viewing a single comment's thread
view the rest of the comments

[-] BaroqueInMind@lemmy.one 4 points 1 week ago* (last edited 1 week ago)

Not for GGUF converted models.

Just run the following command in ollama

ollama run hf.co/wanlige/li-14b-v0.4-Q4_K_M-GGUF

I also recommend you set up Open WebUI as your front-end instead of staying in a terminal.

Also, look into "abliterated" uncensored models. There's plenty of them on hf that are already converted for you

[-] eurisko@lemmy.ca 3 points 1 week ago

That's awesome thank you.

this post was submitted on 18 Apr 2025

22 points (95.8% liked)

LocalLLaMA

2917 readers

118 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

noneabove1182@sh.itjust.works

Smokeydope@lemmy.world

MonsterBug@sh.itjust.works