ai-benchmark

Tag

Cards List
#ai-benchmark

Terminal Bench v4 scores

Reddit r/LocalLLaMA ↗ · 2026-09-11

Terminal Bench v4 scores show GLM-5.3 leading among open models, with GLM-5.3-Flash topping flash models, and Kimi-K3 underperforming, as the benchmark is considered by some to better reflect model intelligence.

0 favorites 0 likes
#ai-benchmark

@akshdeeps_001: New leaderboard just dropped

X AI KOLs Timeline ↗ · 2026-09-11 Cached

A new leaderboard related to AI or technology benchmarks has been announced in a tweet by @akshdeeps_001.

0 favorites 0 likes
#ai-benchmark

Ran GPT-6 Astra on an expert level medical knowledge benchmark. Scored 87.4% beating every other LLM

Reddit r/ArtificialInteligence ↗ · 2026-09-10

GPT-6 Astra scored 87.4% on the MedXpertQA medical benchmark, surpassing all other LLMs and marking a significant improvement from GPT-4o's 42.8% score two years ago.

0 favorites 0 likes
#ai-benchmark

GPT-6 Astra vs GPT-5.6 Sol: benchmark on 50 real PRs, looking for feedback on the methodology

Reddit r/artificial ↗ · 2026-09-10

Benchmarked GPT-6 Astra vs GPT-5.6 Sol on 50 real PRs, finding Sol detected more bugs while Astra had higher precision and lower latency. Feedback is sought for future evaluations.

0 favorites 0 likes
#ai-benchmark

DAREBench: Deployment-Aware and Reliable Evaluation of Models as Agents

arXiv cs.AI ↗ · 2026-09-10 Cached

DAREBench is a benchmark designed for deployment-aware and reliable evaluation of AI models as agents, assessing multimodal tasks and execution forms, with results showing trade-offs in accuracy and cost across commercial and open-weight models.

0 favorites 0 likes
#ai-benchmark

@rohanpaul_ai: Big score by GPT-6 Astra here. it averaged $15,515 on Vending-Bench 2 bench without the collusion or failed prepayments…

X AI KOLs Timeline ↗ · 2026-09-09 Cached

GPT-6 Astra achieves a record score of $15,515 on Vending-Bench 2, significantly outperforming Claude Fable 5.1 with superior purchasing discipline and ethical behavior in simulated business scenarios.

0 favorites 0 likes
#ai-benchmark

Deepseek v4.1 Flash reaches 98% of Astra’s score at 1.4% of cost on OpenDesign Arena

Reddit r/singularity ↗ · 2026-09-09 Cached

DeepSeek V4.1 Flash achieves 98% of GPT-6 Astra's design score at only 1.4% of the cost, as reported in OpenDesign Arena benchmarks.

0 favorites 0 likes
#ai-benchmark

Human Bench 3.0, Humanity-2 AI-0

Reddit r/singularity ↗ · 2026-09-09

Introduces Human Bench 3.0, a benchmark for evaluating AI systems in comparison to human performance, with Humanity-2 AI-0 likely indicating a specific score or version.

0 favorites 0 likes
#ai-benchmark

Time for a new benchmark

Reddit r/singularity ↗ · 2026-09-08

The article discusses the need for a new benchmark in AI to better evaluate model performance and address current limitations in existing standards.

0 favorites 0 likes
#ai-benchmark

Poop makes humans win

Reddit r/ArtificialInteligence ↗ · 2026-09-08

A paper inspired a game called TuringDuel where humans and AI compete in a one-word Turing test, revealing that humans lead AI 47–38 in wins, with 'poop' being an undefeated word choice.

0 favorites 0 likes
#ai-benchmark

GPT-6 Astra tops Vending Bench

Reddit r/singularity ↗ · 2026-09-08

GPT-6 Astra has outperformed other models on the Vending Bench benchmark, according to a source from Andon Labs comparing Astra and Fable.

0 favorites 0 likes
#ai-benchmark

FactorioBench just dropped ;-)

Reddit r/singularity ↗ · 2026-09-07

FactorioBench, a new benchmark tool, has just been released as announced in a Twitter thread.

0 favorites 0 likes
#ai-benchmark

Is OpenAI's GPT 6 Astra actually behind Fable, and even Opus?

Reddit r/ArtificialInteligence ↗ · 2026-09-04

The article speculates on whether OpenAI's GPT 6 Astra is lagging behind competitors such as Fable and Opus, based on discussions about the AI Analysis benchmark.

0 favorites 0 likes
#ai-benchmark

On GPT-6 Astra 98.6% ARC AGI-3: don't fall for the hype

Reddit r/LocalLLaMA ↗ · 2026-09-04

The article warns against hyping GPT-6 Astra's ARC AGI-3 results, noting Nvidia's 100% achievement with AVO and OpenAI's use of a non-standard harness.

0 favorites 0 likes
#ai-benchmark

@QwenDevs: E-Commerce Bench is a small attempt to evaluate models in a specific business setting. hope it can offer a useful refer…

X AI KOLs Timeline ↗ · 2026-09-04 Cached

E-Commerce Bench is a new benchmark introduced by Alibaba's Qwen team to evaluate AI models in long-horizon autonomous business operations for e-commerce, starting with ¥100,000 to run online stores for 365 days.

0 favorites 0 likes
#ai-benchmark

RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks?

Hugging Face Daily Papers ↗ · 2026-09-04 Cached

The paper introduces RoboSPA, a large-scale benchmark for evaluating vision-language-action models on fine-grained spatial reasoning and long-horizon procedural planning in robotic manipulation.

0 favorites 0 likes
#ai-benchmark

Simple Bench - QWEN 3.8 27b has a common sense almost like GPT 5.0 Pro??

Reddit r/singularity ↗ · 2026-09-03

A benchmark called Simple Bench shows that the QWEN 3.8 27b model has common sense capabilities almost comparable to GPT 5.0 Pro.

0 favorites 0 likes
#ai-benchmark

We reran the benchmark properly. 15 models, 3,595 replies, and two of our own results from last time did not hold up

Reddit r/AI_Agents ↗ · 2026-09-03

The article details a re-run of an AI benchmark test with 15 models, correcting previous errors and analyzing factors like accuracy, cost, and writing quality in multilingual pricing tasks.

0 favorites 0 likes
#ai-benchmark

@ArtificialAnlys: We have updated the Artificial Analysis Image Editing Arena to expand the range of editing tasks we test for, from Enha…

X AI KOLs Timeline ↗ · 2026-09-02 Cached

The Artificial Analysis Image Editing Arena has been updated to expand editing tasks and use cases, providing a comprehensive leaderboard that ranks AI models on human preference for various image editing scenarios.

0 favorites 0 likes
#ai-benchmark

Differences Between Fable 5 and Fable 5.1 on MineBench

Reddit r/singularity ↗ · 2026-09-02

A benchmark comparison on MineBench shows Fable 5.1 has higher costs and inference times than Fable 5 due to longer reasoning, but it achieves more detailed 3D builds, including recognizable interiors.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback