You could purchase a Desktop with 2TB of DDR5 - It only sets you back some $200k+

Reddit r/LocalLLaMA News

Summary

A look at the HP Z8 Fury workstation's insane 2TB DDR5 configuration costing over $200k just for RAM, and how current Nvidia RTX Pro 6000 price hikes make buying the base system with 4 GPUs a better deal than standalone cards.

Just watched Wendell's (level1 techs) latest video on the HP Z8 Fury desktop workstation and was curious how you could configure it. And oh boy, there's an option for 2TB which costs some $211k just for the RAM alone. But the real interesting part with the latest price hikes for Nvidia RTX Pro 6000 cards is the fact, that if you're in the market for 4 units, it's better to purchase the base version of this system with 4x RTX Pro 6000, which amounts to $64k. At the single unit price of around $16k per pice by now, you get the rest of the components for free if you purchase the system. He also mentions, that purchasing such a system through resellers sometimes gets you even a much better deal. Gotta be shwifty in these crazy times.
Original Article

Similar Articles

Ultra budget 20GB vram with 448GB/s for $100 bucks.

Reddit r/LocalLLaMA

Demonstrates achieving 20GB VRAM and 448GB/s bandwidth for around $100 using two NVIDIA P102-100 cards, running a llama.cpp server with a Qwen model and supporting 3 concurrent users with large context.

Was my $48K GPU server worth it?

Hacker News Top

A former FAANG engineer recounts building a $48K GPU server with six RTX 6000 Ada cards for independent AI research, detailing the build process, power constraints, and a cost comparison against cloud GPU rentals.