EdgeBench Reveals the Next Scaling Law: On-the-Fly AI Learning Speed Doubles Every 3 Months
Summary
EdgeBench reveals a new scaling law indicating that on-the-fly AI learning speed doubles every three months.
Similar Articles
EdgeBench: Unveiling Scaling Laws of Learning from Real-World Environments
EdgeBench analyzes 38,000 hours of real-world agent interactions across 134 tasks, revealing log-sigmoid scaling laws for performance and exponential learning speed improvements. The paper introduces a benchmark suite for studying how agents learn from real-world experience.
@xiaogaifun: https://x.com/xiaogaifun/status/2073771786202939572
The ByteDance Seed team released the EdgeBench benchmark, which allows AI models to work continuously for 12-72 hours to evaluate their learning ability in long-horizon tasks. They discovered that the relationship between the time spent learning from the environment and performance follows a log-sigmoid curve, revealing a new scaling law.
AI and compute
OpenAI releases an analysis demonstrating that compute used in largest AI training runs has grown exponentially at a 3.4-month doubling time since 2012, representing a 300,000x increase and vastly outpacing Moore's Law. The analysis suggests this trend will likely continue and calls for increased academic AI research funding to address rising computational costs.
The cost of a given X level of AI intelligence is cut in half every 2-4 months.
The article analyzes how the cost to achieve a given level of AI intelligence, measured by Epoch AI's ECI, halves every 2-4 months, citing examples from Grok, DeepSeek, GPT, and Gemini.
AI is scaling 3x faster than the internet wave and it’s NOT slowing down
The article highlights that AI adoption is accelerating three times faster than the internet boom, with no signs of slowing down.