SlopCodeBench 10/2026 – Opus 5.5, Astra wins overall, xhigh considered harmful

Hacker News Top 10/15/26, 07:09 PM News

Summary

SlopCodeBench 的 10/2026 更新显示，Opus 5.5 与 Astra 在整体表现中领先，而 xhigh 被认为存在负面影响。该基准通过逐步披露功能检查点、让模型在继承同一代码库的多阶段挑战中工作，更贴近真实软件开发流程。

Quick update here since a lot of folks asked about what slopcodebench is / where it fits inSlop code bench is unique among benchmarks in that it makes a model work against a progressively disclosed list of features (checkpoints) that it doesn’t know it advance, inheriting the same codebase through the lifecycle of a single multi-checkpoint challengeI like this because it much more mirrors how real software dev happens, rather than most benchmarks with one off tasks where slop code doesn’t hinder future progressThe original post[1] and the SOL/fable follow up[2] went into a bit more detail on the benchmark and its challenges1. <a href="https://news.ycombinator.com/item?id=49076391">https://news.ycombinator.com/item?id=49076391</a>2. <a href="https://github.com/humanlayer/advanced-context-engineering-for-coding-agents/blob/main/benchmarking-sol-fable-kimi-on-slop-code-bench.md" rel="nofollow">https://github.com/humanlayer/advanced-context-engineering-f...</a>

Original Article

Similar Articles

Benchmarking Opus 5 on SlopCodeBench

Hacker News Top

Benchmarking the performance of the Opus 5 model on the SlopCodeBench benchmark.

Opus 5.5 (high) improves on Opus 5 (high) 3.5 → 3.8 on the Short-Story Creative Writing Benchmark, just behind Fable 5.1 (high) and Opus 5 (xhigh).

Reddit r/singularity

The article reports on the latest scores from the Short-Story Creative Writing Benchmark, showing improvements in AI models like Opus 5.5, Grok 4.7, and Gemini 3.8 Flash, with a leaderboard covering 56 models and over 100,000 evaluator judgments.

Without citing benchmarks, are you able to tell me why Astra is better than Fable? Or how Opus 5.5 is better than 6.1 Sol?

Reddit r/ArtificialInteligence

The author theorizes that new AI model baselines may be so high that humans can't distinguish between them without benchmarks, raising questions about whether benchmark-maxing matters most for private AI lab valuation.

Claude Opus 5.5 can now rebuild real programs from scratch — 18.5% on ProgramBench, up from 0% in May

Reddit r/artificial

Claude Opus 5.5 (xhigh) resolves 18.5% of ProgramBench's 200 from-scratch program rebuild tasks, up from 0% at the benchmark's May launch, per Jack Clark's Import AI. Clark predicts the benchmark could saturate by end of 2027, raising questions about whether it truly measures software engineering ability or just reverse-engineering persistence.

Artificial Analysis Intelligence Index v5