0
submitted 1 week ago by Tea@programming.dev to c/hardware@lemmy.ml

In today’s AI-driven world, the ability to train AI models locally and perform fast inference on GPUs at an optimal cost is more important than ever. Building your own GPU server with an RTX 4090 or RTX 5090 — like the one described here — enables a high-performance eight-GPU setup running on PCIe 5.0 with full x16 lanes. This configuration ensures maximum interconnect speed for all eight GPUs. In contrast, most similar setups are limited by the PCIe bus version (such as PCIe 4.0 or even lower), due to the challenges of running longer PCIe extensions.

top 3 comments
sorted by: hot top controversial new old

Am I missing the point or do these people have buckets of cash to spend?

[-] okwhateverdude@lemmy.world 4 points 1 week ago

silicon valley tech bro VCs, so yeah

[-] pineapple@lemmy.ml 5 points 1 week ago

At that point they should be using h100's 4090's are far from efficient.

this post was submitted on 04 Apr 2025
0 points (50.0% liked)

Hardware

5422 readers
48 users here now

This is a community dedicated to the hardware aspect of technology, from PC parts, to gadgets, to servers, to industrial control equipment, to semiconductors.

Rules:

founded 5 years ago
MODERATORS