Tag
The article discusses the evolving importance of data versus algorithmic progress in AI development, drawing from recent talks by researchers to highlight a shift in focus.
OpenAI analyzes trends in AI algorithmic efficiency, showing that compute required to reach AlexNet-level performance has halved roughly every 16 months since 2012, outpacing hardware gains. The study draws comparisons across domains like DNA sequencing and transistor density to contextualize AI progress.