-1
Ask Lemmy: What do you currently use for AI coding?
(lemmy.world)
Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!
Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.
Hope you enjoy the instance!
Rules
Follow the wormhole through a path of communities !webdev@programming.dev
How do you get your LLM credits? Or do you run Gemma and Qwen locally? With which hardware?
For Claude I have the lowest tier subscription through work. I also have openrouter to use occasionally when I need it. Gemma and Qwen I run locally on a strix halo framework desktop I bought just before ram prices went to the moon.
So, CPU only?
No, Strix halo is AMD's integrated CPU GPU using unified ram. Its the non apple tax equivalent of the mac minis people have been using to run local models. On one hand its a bit slower as it has lower memory bandwidth and that's the limiting factor, but on the other its less than half the price for more memory and runs linux rather than osx.
Excellent, thanks for the explanation!