@AnthropicAI: Each time we release a model, we run the same test: give it code that trains a small AI model, ask the new model to spe…

X AI KOLs News
ai-benchmarking ai-performance code-optimization anthropic claude ai-progress

Summary

Anthropic shares internal benchmark results showing dramatic AI coding improvement: while Claude Opus 4 averaged ~3x speedup on an ML code optimization task in May 2024, the new Mythos Preview model achieved ~52x speedup this April, compared to 4-8 hours for a skilled human to reach 4x.

Each time we release a model, we run the same test: give it code that trains a small AI model, ask the new model to speed it up. It takes a skilled human 4-8 hours to reach 4x faster. In May 2024, Claude Opus 4 averaged a ~3x speedup. This April, Mythos Preview achieved ~52x.
Original Article

Similar Articles

Mythos can improve speed of training code 52x (compared to human 4x at 4-8hrs)

Reddit r/singularity

Anthropic's Mythos system achieved a 52x speedup in optimizing training code compared to a human's 4x speedup over 4-8 hours on the same task, with the caveat that absolute multiples depend heavily on starting code quality. The like-for-like comparison shows roughly 3x–52x improvement across models over the past year.

@FinanceYF5: 3/ He believes the AI capability leap in the past 5 months comes not only from tool advancements like Claude Code, but because of 【Mythos】—a new Anthropic model that quietly changed the entire R&D rhythm after its training completed in February this year. Key takeaway: Leading models are helping to train the next generation of leading models...

X AI KOLs Following

According to speculation, Anthropic's new model Mythos, after completing training in February this year, quietly changed the R&D rhythm, leading to a significant leap in AI capabilities over the past 5 months. Leading models are helping to train the next generation of models.