@TheAhmadOsman: Hey my friend, cool setup. If 8x RTX PRO 6000s is the real goal, I’d treat it like a serious infra build, not a worksta…

X AI KOLs Timeline News

Summary

Advice on building a high-end AI workstation with 8x RTX PRO 6000 GPUs, emphasizing proper infrastructure, cooling, and avoiding reuse of DDR4.

Hey my friend, cool setup. If 8x RTX PRO 6000s is the real goal, I’d treat it like a serious infra build, not a workstation. I wouldn’t optimize around attempting to reuse DDR4. This will be a 100k+ machine and you’ll be glad you did it right. You can always sell the DDR4 to recoup costs. Once you are chasing lots of PCIe Gen5 lanes, you’re basically in DDR5/ECC RDIMM territory anyway. GENOAD8X feels like strong fit here with MCIO and CPayne PCBs: 7x Gen5 x16 + 1x Gen5 x8, and no need for bifurcation. True 8x16 is rare of course because it soaks up 128 lanes before storage/networking. Biggest questions are 240V power, panel headroom for the increased electrical load, system airflow, and cooling. You can absolutely stay air cooled even with a full power deployment like this (it’s actually the most common setup for commercial servers below the enterprise data center tier), and you’ll just be sizing and installing dedicated cooling which will of course also have its own power requirements. A lot of good options here. Happy to talk it through anytime.
Original Article

Similar Articles

Was my $48K GPU server worth it?

Hacker News Top

A former FAANG engineer recounts building a $48K GPU server with six RTX 6000 Ada cards for independent AI research, detailing the build process, power constraints, and a cost comparison against cloud GPU rentals.