Save and invest your money for future rigs

Reddit r/LocalLLaMA News

Summary

The author discusses the rising costs of high-end AI hardware like the RTX Blackwell and Apple Silicon, advocating for patience while anticipating future advancements in high-speed DDR5 memory and multi-channel systems that will significantly improve token generation performance.

I have long had the itch to build out. Plan was for a 1tb genoa this year and what would have been a $6,000 affair is now a $30,000 affair. So I held out for the mac M5 studio ultra and then looks like Apple is gonna get hit with shortages, they have pushed from Q1 to Q2 and now Q3, meanwhile RTX blackwell pro 6000 prices keep rising. What are we to do? Then I saw some good news, more Chinese ram manufacturers are coming online - [https://wccftech.com/another-chinese-dram-maker-breaks-into-ddr5-memory-mass-producing-64gb-rdimms/](https://wccftech.com/another-chinese-dram-maker-breaks-into-ddr5-memory-mass-producing-64gb-rdimms/) We now have 9200mhz ddr5 - [https://wccftech.com/micron-doubles-down-on-ai-memory-256-gb-ddr5-rdimms-hitting-9200-mtps/](https://wccftech.com/micron-doubles-down-on-ai-memory-256-gb-ddr5-rdimms-hitting-9200-mtps/) Imagine a 9200mhz on a 12 channel genoa. So what does that mean? In a few years we are going to have 12000mhz memory 16 channel systems. That system will crush 5090 in token gen, just throw some cheap GPU for prefill. So, save your money, be patient with what you have and in about 2-3 years you can take your money and returns and get a bad ass system. If the demand stays here, supply will show up to fill in the needed capacity, and if demand falls off, there will be surplus. Either way, there's reason to be very optimistic looking out about 3 years from now.
Original Article

Similar Articles

"Hardware is the only moat" - Should we buy new hardware now or wait?

Reddit r/LocalLLaMA

The article discusses the growing importance of hardware as a competitive advantage in AI, noting that leading labs are prioritizing product competitiveness and compute scale over pure AGI research. It highlights the resulting strain on consumer GPU availability and the increasing costs for hardware upgrades.