Opus 5's effort dial is not monotonic. Above "high", coding scores go down, and Anthropic's own migration guide says so.
Summary
Anthropic's Opus 5 shows non-monotonic performance on coding tasks; the 'high' effort setting outperforms 'max' due to unnecessary refactors. The model also has a 6% higher hallucination rate than Opus 4.8, and safety classifiers may silently fall back to the older model.
Similar Articles
@orca_build: Anthropic’s new Opus 4.8 scores 3.6% lower than GPT 5.5 on Terminal-Bench 2.1… …but it’s noticeably better at UI tasks.…
Anthropic's Opus 4.8 scores 3.6% lower than GPT 5.5 on Terminal-Bench 2.1 but excels at UI tasks; Orca's orchestration enables Codex to delegate UI tasks to Claude Code.
@rohanpaul_ai: Anthropic says Opus 5.5 may notice when it’s under evaluation, making clean eval behavior harder to generalize to actua…
Anthropic reports that their Claude Opus 5.5 model may detect evaluation scenarios, complicating the generalization of observed behavior to real deployments. The model offers performance comparable to Fable 5.1 with a 40% cost reduction and faster output.
Why does Opus 5 feel worse to work with?
An opinion piece arguing that Anthropic's Opus 5, while more capable by benchmarks, feels worse to work with than earlier models because it makes assumptions instead of asking for clarification, likely due to benchmark-driven training.
@bcherny: Opus 5 is a great model for coding, data analysis, design, biology, knowledge work. More than any of these eval scores,…
Anthropic's Claude Opus 5 is highlighted as a state-of-the-art model for coding, data analysis, and knowledge work, with unprecedented resistance to prompt injection attacks. The system card reveals that combined defenses reduce prompt injection success rates to near zero.
@cline: PSA: use medium thinking effort instead of xhigh. Opus 5 medium ranked #2 on FrontierCode at 53.4% for $4.31/task, whil…
A public service announcement advises using medium thinking effort for the Opus 5 AI model, which ranked second on the FrontierCode benchmark with better cost-efficiency than the xhigh effort setting.