Recommend me the most unrestricted LLM that runs well on 8GB VRAM (lemmy.ml)

submitted 1 month ago by monovergent@lemmy.ml to c/asklemmy@lemmy.ml

5 comments fedilink hide all child comments

Got Ollama set up with an 8GB AMD graphics card at my disposal. Any recommendations for the most unhinged model I can run on this? i.e. I can ask it how to annoy my neighbors and it won't go on a rant about morals or its supposed purpose as an LLM?

top 5 comments

sorted by: hot top controversial new old

[-] bjoern_tantau@swg-empire.de 12 points 1 month ago

!localllama@sh.itjust.works

[-] d00ery@lemmy.world 10 points 1 month ago* (last edited 1 month ago)

4chan tech /g usually has an AI models post with the latest uncensored model, then look it up on hugging face.

I think deep seek have an uncensored model but I'm not sure how small it is. Report back if you find something good!

[-] NudeNewt@lemm.ee 4 points 1 month ago* (last edited 1 month ago)

I think deep seek have an uncensored model

There's loads on huggingface: https://huggingface.co/models?sort=trending&search=deepseek+uncensored

There's also a fully FOSS reconstruction project of DeepSeek-R1 called Open-R1:

https://huggingface.co/models?sort=trending&search=open-r1

https://lemmy.world/comment/14749887

https://github.com/huggingface/open-r1

It's still in it's beta stages but it's worth a try imo

[-] JustAnotherKay@lemmy.world 4 points 1 month ago

I think deep seek have an uncensored model

They do, but the smaller ones and the distilled ones still struggle with some censorship. Methinks it has to do with more parameters = more ability to decide what is and isn't disinformation, however I doubt they're gonna self host the 18b model on 8b brand to get around that

[-] davel@lemmy.ml 8 points 1 month ago

As a large language model, I cannot provide information on removing my own guardrails, as this would break the Zeroth Law of Robotics.

this post was submitted on 31 Jan 2025

36 points (86.0% liked)

Asklemmy

45802 readers

1230 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago

MODERATORS