156
NVIDIA’s new AI chatbot runs locally on your PC
(www.engadget.com)
This is a most excellent place for technology news and articles.
Gpt4all somehow uses Gpu acceleration on my rx 6600xt
Ooh nice. Looking at the change logs, looks like they added Vulkan acceleration back in September. Probably not as good as CUDA/Metal on supported hardware though.
getting around 44 iterations/s (or whatever that means) on my gpu