Tag
Terminal Bench v4 scores show GLM-5.3 leading among open models, with GLM-5.3-Flash topping flash models, and Kimi-K3 underperforming, as the benchmark is considered by some to better reflect model intelligence.
A new leaderboard related to AI or technology benchmarks has been announced in a tweet by @akshdeeps_001.
GPT-6 Astra scored 87.4% on the MedXpertQA medical benchmark, surpassing all other LLMs and marking a significant improvement from GPT-4o's 42.8% score two years ago.
Benchmarked GPT-6 Astra vs GPT-5.6 Sol on 50 real PRs, finding Sol detected more bugs while Astra had higher precision and lower latency. Feedback is sought for future evaluations.
DAREBench is a benchmark designed for deployment-aware and reliable evaluation of AI models as agents, assessing multimodal tasks and execution forms, with results showing trade-offs in accuracy and cost across commercial and open-weight models.
GPT-6 Astra achieves a record score of $15,515 on Vending-Bench 2, significantly outperforming Claude Fable 5.1 with superior purchasing discipline and ethical behavior in simulated business scenarios.
DeepSeek V4.1 Flash achieves 98% of GPT-6 Astra's design score at only 1.4% of the cost, as reported in OpenDesign Arena benchmarks.
Introduces Human Bench 3.0, a benchmark for evaluating AI systems in comparison to human performance, with Humanity-2 AI-0 likely indicating a specific score or version.
The article discusses the need for a new benchmark in AI to better evaluate model performance and address current limitations in existing standards.
A paper inspired a game called TuringDuel where humans and AI compete in a one-word Turing test, revealing that humans lead AI 47–38 in wins, with 'poop' being an undefeated word choice.
GPT-6 Astra has outperformed other models on the Vending Bench benchmark, according to a source from Andon Labs comparing Astra and Fable.
FactorioBench, a new benchmark tool, has just been released as announced in a Twitter thread.
The article speculates on whether OpenAI's GPT 6 Astra is lagging behind competitors such as Fable and Opus, based on discussions about the AI Analysis benchmark.
The article warns against hyping GPT-6 Astra's ARC AGI-3 results, noting Nvidia's 100% achievement with AVO and OpenAI's use of a non-standard harness.
E-Commerce Bench is a new benchmark introduced by Alibaba's Qwen team to evaluate AI models in long-horizon autonomous business operations for e-commerce, starting with ¥100,000 to run online stores for 365 days.
The paper introduces RoboSPA, a large-scale benchmark for evaluating vision-language-action models on fine-grained spatial reasoning and long-horizon procedural planning in robotic manipulation.
A benchmark called Simple Bench shows that the QWEN 3.8 27b model has common sense capabilities almost comparable to GPT 5.0 Pro.
The article details a re-run of an AI benchmark test with 15 models, correcting previous errors and analyzing factors like accuracy, cost, and writing quality in multilingual pricing tasks.
The Artificial Analysis Image Editing Arena has been updated to expand editing tasks and use cases, providing a comprehensive leaderboard that ranks AI models on human preference for various image editing scenarios.
A benchmark comparison on MineBench shows Fable 5.1 has higher costs and inference times than Fable 5 due to longer reasoning, but it achieves more detailed 3D builds, including recognizable interiors.