Tag
The article criticizes Arena.ai for allegedly running dishonest benchmarks, claiming it ranked GPT 5.5 below Meta's Muse Spark in coding and Grok Imagine above Seedance in video generation, which the author asserts is objectively false.
The author launches 'AI IQ', a new tool that scores frontier AI models on the human IQ scale, providing visualizations of model performance, intelligence costs, and EQ comparisons rather than standard leaderboard tables.
Artificial Analysis introduces the Coding Agent Index, a new benchmark suite combining SWE-Bench-Pro-Hard-AA, Terminal-Bench v2, and SWE-Atlas-QnA to evaluate the performance of AI coding agents across diverse tasks.
The author introduces the site plan for effectiveTPS, a tool designed to compare local AI models using a new 'effective TPS' metric alongside raw speed and latency. It aims to provide a simple leaderboard that highlights useful output quality over raw marketing numbers.
Google DeepMind and Kaggle introduced Kaggle Game Arena, an open-source AI benchmarking platform where large language models compete head-to-head in strategic games to provide dynamic and verifiable evaluation of their capabilities. The platform addresses limitations of traditional benchmarks by offering clear winning conditions and unambiguous performance signals.