@AnthropicAI: Each time we release a model, we run the same test: give it code that trains a small AI model, ask the new model to spe…

X AI KOLs News
ai-benchmarking ai-performance code-optimization anthropic claude ai-progress

Summary

Anthropic shares internal benchmark results showing dramatic AI coding improvement: while Claude Opus 4 averaged ~3x speedup on an ML code optimization task in May 2024, the new Mythos Preview model achieved ~52x speedup this April, compared to 4-8 hours for a skilled human to reach 4x.

Each time we release a model, we run the same test: give it code that trains a small AI model, ask the new model to speed it up. It takes a skilled human 4-8 hours to reach 4x faster. In May 2024, Claude Opus 4 averaged a ~3x speedup. This April, Mythos Preview achieved ~52x.
Original Article

Similar Articles

Mythos can improve speed of training code 52x (compared to human 4x at 4-8hrs)

Reddit r/singularity

Anthropic's Mythos system achieved a 52x speedup in optimizing training code compared to a human's 4x speedup over 4-8 hours on the same task, with the caveat that absolute multiples depend heavily on starting code quality. The like-for-like comparison shows roughly 3x–52x improvement across models over the past year.