submitted 20 hours ago by muntedcrocodile@lemm.ee to c/localllama@sh.itjust.works

14 comments fedilink hide all child comments

Do i need industry grade gpu's or can i scrape by getring decent tps with a consumer level gpu.

you are viewing a single comment's thread
view the rest of the comments

[-] Gladaed@feddit.org 2 points 20 hours ago

Round about that much vram. I.e. 90 GB

this post was submitted on 10 Jan 2025

11 points (92.3% liked)

LocalLLaMA

2410 readers

27 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago

MODERATORS