46
you are viewing a single comment's thread
view the rest of the comments
[-] yo_scottie_oh@lemmy.ml 2 points 18 hours ago

Do you run this on NVIDIA or AMD hardware?

[-] brucethemoose@lemmy.world 3 points 17 hours ago

Nvidia.

Back then I had a 980 TI RN I am lucky enough to have snagged a 3090 before they shot up.

I would buy a 7900, or a 395 APU, if they were even reasonably affordable for the VRAM, but AMD is not pricing their stuff well…

But FYI you can fit Qwen 32B on a 16GB card with the right backend/settings.

this post was submitted on 04 May 2025
46 points (79.5% liked)

Asklemmy

47852 readers
1103 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 6 years ago
MODERATORS