@Suhail: Every time I acquire more compute, I discover that I could use even more compute to do other new things.
Summary
A personal observation that acquiring more compute only reveals further needs for compute, reflecting the insatiable demand in AI and tech.
Similar Articles
@Miles_Brundage: Automated AI R+D, recursive self-improvement, etc. all feel like compute in a trench coat to me In the sense that they …
Miles Brundage argues that automated AI R&D and recursive self-improvement are fundamentally dependent on compute being above a critical level and continuously increasing.
AI and compute
OpenAI releases an analysis demonstrating that compute used in largest AI training runs has grown exponentially at a 3.4-month doubling time since 2012, representing a 300,000x increase and vastly outpacing Moore's Law. The analysis suggests this trend will likely continue and calls for increased academic AI research funding to address rising computational costs.
Why compute might get 10x more expensive in coming years (8 minute read)
The article analyzes factors that could drive AI compute costs up 10x in coming years, including rising lab revenue, margins, and spot prices, while suggesting that inference spending may signal stalled progress.
Elon Musk: “If Chinese Companies had a lot of Compute, good chance that They Would be Leaders in AI. At Some Point, They will probably have More Compute”
Elon Musk comments that Chinese companies could become leaders in AI if they had sufficient computing power, and predicts they will eventually have more compute resources.
@Dropbox: When demand goes up, adding more hardware can seem like the obvious answer. But it’s not always the best one. Here’s ho…
Dropbox discusses strategies to improve infrastructure efficiency in response to growing AI demand, focusing on system-level optimization rather than just adding more hardware.