156
NVIDIA’s new AI chatbot runs locally on your PC
(www.engadget.com)
This is a most excellent place for technology news and articles.
I'd hope that this uses the hardware better than Pytorch. Otherwise, why the specific hardware demands? Well, it can always be marketing.
There are several alternatives that offer 1-click installers. EG in this thread:
AGPL-3.0 license: https://jan.ai/
MIT license: https://ollama.com/
MIT license: https://gpt4all.io/index.html
(There's more.)