EdgeBench Reveals the Next Scaling Law: On-the-Fly AI Learning Speed Doubles Every 3 Months
Summary
EdgeBench reveals a new scaling law indicating that on-the-fly AI learning speed doubles every three months.
Similar Articles
EdgeBench: Unveiling Scaling Laws of Learning from Real-World Environments
EdgeBench analyzes 38,000 hours of real-world agent interactions across 134 tasks, revealing log-sigmoid scaling laws for performance and exponential learning speed improvements. The paper introduces a benchmark suite for studying how agents learn from real-world experience.
@xiaogaifun: https://x.com/xiaogaifun/status/2073771786202939572
The ByteDance Seed team released the EdgeBench benchmark, which allows AI models to work continuously for 12-72 hours to evaluate their learning ability in long-horizon tasks. They discovered that the relationship between the time spent learning from the environment and performance follows a log-sigmoid curve, revealing a new scaling law.
AI and compute
OpenAI releases an analysis demonstrating that compute used in largest AI training runs has grown exponentially at a 3.4-month doubling time since 2012, representing a 300,000x increase and vastly outpacing Moore's Law. The analysis suggests this trend will likely continue and calls for increased academic AI research funding to address rising computational costs.
Accelerating rate of Major AI Model Releases
This article examines the accelerating pace at which frontier AI models are being released, highlighting the trend of shorter intervals between major model launches.
Interesting post from Adam Majmudar (research at OpenAI) — full text in body
An analysis by Adam Majmudar on the rapid progression of AI capabilities, highlighting how new scaling laws are driving leaps beyond external expectations.