479
Your AI Girlfriend Is a Data-Harvesting Horror Show
(gizmodo.com)
This is a most excellent place for technology news and articles.
You'll want to use a quantised model on your GPU. You could also use the CPU and offload some parts to the GPU with llama.cpp (an option in oobabooga). Llama.cpp models are in the GGUF format.