[-] donatas@feddit.uk 4 points 3 months ago

128GB won't make any difference in gaming when compared to, say, 32GB, so it's just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.

[-] donatas@feddit.uk 5 points 3 months ago

Performance/vision based tests have tokens/s at the end of tables.

43
submitted 3 months ago by donatas@feddit.uk to c/selfhosted@lemmy.world

donatas

joined 4 months ago