15
What is a good model that runs on 6GB Vram?
(discuss.online)
Community to discuss about LLaMA, the large language model created by Meta AI.
This is intended to be a replacement for r/LocalLLaMA on Reddit.
I'll see, maybe I could work with 14b after all... Maybe...