Fable passes the "When A.I. Passes This Test, Look Out" test

Reddit r/ArtificialInteligence Models

Summary

Claude Fable achieves 53% on the 'Humanity's Last Exam' benchmark, surpassing the expected end-of-2025 milestone earlier than projected, indicating rapid AI progress.

New York Times article on Jan 2025 - "When A.I. Passes This Test, Look Out" and Claude Fable just passed it at 53%. But they also said that it would pass this at the end of 2025 and this is about 6 months late. [https://www.nytimes.com/2025/01/23/technology/ai-test-humanitys-last-exam.html](https://www.nytimes.com/2025/01/23/technology/ai-test-humanitys-last-exam.html) *Mr. Hendrycks said he expected those scores to rise quickly, and potentially to surpass 50 percent by the end of the year. At that point, he said, A.I. systems might be considered “world-class oracles,” capable of answering questions on any topic more accurately than human experts*
Original Article

Similar Articles

Claude Fable 5 benchmarks

Reddit r/singularity

Anthropic released benchmarks for Claude Fable 5, a new AI model, showing significant performance improvements.

Fable is the ceiling.

Reddit r/artificial

A commentary piece speculates that Anthropic's Fable model may represent the ceiling of American AI progress, and that Chinese AI developers will soon outpace US frontier models due to faster iteration and distillation techniques.

humanity's last exam current benchmarks thoughts?

Reddit r/singularity

Discussion of recent AI model scores on the 'humanity's last exam' benchmark, noting improvement from GPT-4o's 2.7% in May 2024 to around 45% by June 2026, questioning the exam's difficulty.