657
The Rule (lemmy.ml)
submitted 4 months ago by roon@lemmy.ml to c/196@lemmy.blahaj.zone
you are viewing a single comment's thread
view the rest of the comments
[-] AdrianTheFrog@lemmy.world 1 points 4 months ago

PCIe will probably be the bottleneck way before the number of GPUs is, if you're planning on storing the model in ram. Probably better to get a high end server CPU.

this post was submitted on 25 Jul 2024
657 points (100.0% liked)

196

16591 readers
2928 users here now

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

^other^ ^rules^

founded 1 year ago
MODERATORS