Is foundational AI research still something that can be done without access to HPC? [D]

Reddit r/MachineLearning News

Summary

A discussion on whether foundational AI research can be done without access to high-performance computing, given that early work like 'Attention is all you need' used consumer GPUs.

I'm not that well versed in ML yet. I know that "Attention is all you need" was based on work that was done with a couple of high end gaming GPUs at the time. I can afford that. Suppose for arguments sake that I have caught up on ML such that I have the competence to recreate state of the art results should I have access to the required hardware, do I still need access to huge amounts of hardware infrastructure to be able to contribute to the field at a foundational level?
Original Article

Similar Articles

Will financing bottleneck AI compute? An Anthropic case study (15 minute read)

TLDR AI

Epoch AI analyzes whether financing will bottleneck AI compute scaling, using Anthropic's $50B infrastructure buildout funded by debt as a case study. It argues institutional investors are willing to lend against long-term payment commitments, especially with supplier backing, making financing unlikely to be the immediate limit on frontier compute growth.