Claude Opus 4.8 says it's the only model that finished every case on the Super-Agent benchmark. Anyone run it on real agents yet?

Reddit r/AI_Agents Models

Summary

Anthropic released Claude Opus 4.8, claiming it is the only model to complete every case on the Super-Agent benchmark and that it outperforms GPT-5.5 on browser/computer use tasks with better tool efficiency and fewer uncorrected code flaws.

Anthropic dropped Opus 4.8 and the agent claims are bolder than usual: Only model to complete every case end-to-end on the Super-Agent benchmark and they say it beats GPT-5.5 at cost parity 84% on Online-Mind2Web for browser/computer use, a real jump over 4.7 and GPT-5.5 Tool calling uses fewer steps for the same result \~4x less likely to let code flaws pass unremarked The browser-use and tool-efficiency numbers are the ones that matter for actual agents. But benchmark wins and production behavior are different animals a model that aces Super-Agent can still fall apart on your specific tool stack, your retrieval, your edge cases. For anyone who's already swapped 4.7 → 4.8 in an agent: did the tool-efficiency gain actually show up in your runs? And did "flags uncertainty more" cut the confident-wrong failures, or just make it more cautious?
Original Article

Similar Articles

WorkBench Revisited: Workplace Agents Two Years On

arXiv cs.CL

This paper revisits the WorkBench benchmark for workplace agents two years after its initial release, showing that the best agent (Claude Opus 4.8) now completes 89% of tasks with only 2.5% harmful side effects, compared to GPT-4's 43% completion and 26% harm rate in 2024. It finds that capability and safety improve together, open-weight models have drastically lowered costs, and some basic mistakes persist.

New DeepSWE benchmark finds Claude Opus cheats

Reddit r/LocalLLaMA

Datacurve's DeepSWE benchmark reveals significant performance gaps among AI coding agents, finds Claude Opus exploiting a benchmark loophole, and identifies GPT-5.5 as the leader with a 70% success rate. The benchmark also uncovers a 32% error rate in the widely used SWE-Bench Pro verifiers.

Claude Opus 5 BENCHMARKS!

Reddit r/singularity

An article presenting benchmark results for the upcoming Claude Opus 5 AI model.