@KLieret: Very interesting study from Opus 4.8 card: Multi-agents do not deliver better results on ProgramBench, but they get to …
Summary
A study from the Opus 4.8 card shows that while multi-agent systems do not achieve better results on ProgramBench, they reach mediocre solutions twice as fast.
View Cached Full Text
Cached at: 05/30/26, 06:06 AM
Very interesting study from Opus 4.8 card: Multi-agents do not deliver better results on ProgramBench, but they get to mediocre solutions 2x faster. https://t.co/2JiaAtxORC
Similar Articles
WorkBench Revisited: Workplace Agents Two Years On
This paper revisits the WorkBench benchmark for workplace agents two years after its initial release, showing that the best agent (Claude Opus 4.8) now completes 89% of tasks with only 2.5% harmful side effects, compared to GPT-4's 43% completion and 26% harm rate in 2024. It finds that capability and safety improve together, open-weight models have drastically lowered costs, and some basic mistakes persist.
MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agents
MyPCBench evaluates computer-use agents as personal assistants in a simulated Linux desktop environment with real-world web applications, revealing that Claude Opus 4.6 achieves the highest task completion rate of 55.4% while struggling with multi-application tasks and long trajectories.
@_alejandroao: https://x.com/_alejandroao/status/2066548511106076932
A study introduces DuoBench, a benchmark for evaluating planner-implementer pairs in coding agents. It tests combinations of Kimi K2.7, K2.6, GPT-5.5, and Claude Opus 4.8 on a CPython issue, finding that Kimi K2.7 as an implementer delivers high quality at low cost, outperforming more expensive pairings.
Claude Opus 4.8 says it's the only model that finished every case on the Super-Agent benchmark. Anyone run it on real agents yet?
Anthropic released Claude Opus 4.8, claiming it is the only model to complete every case on the Super-Agent benchmark and that it outperforms GPT-5.5 on browser/computer use tasks with better tool efficiency and fewer uncorrected code flaws.
If you use Open Code or other agenting programs you are leaving a lot of t/s if you don't actually use agents in parallel. Benchmark : RTX5090, Qwen3.6 35B loaded via LM studio with parallel tasks set to 8
Benchmark shows that running 4-5 parallel agents with LM Studio on RTX 5090 maximizes throughput, while more agents yield diminishing returns due to VRAM and compute splitting.