On a difficult new SWE benchmark, ProgramBench, GPT5.5 high/xhigh solves a task for first time, significantly outperforms Opus 4.7
Summary
GPT5.5 achieved the first solve on the difficult ProgramBench SWE benchmark, significantly outperforming Opus 4.7.
Similar Articles
@sashimikun_void: GPT-5.5 outperformed Claude Opus 4.8 on the DEEPSWE benchmark. Opus 4.8 takes twice as long, generates three times the …
GPT-5.5 outperforms Claude Opus 4.8 on the DEEPSWE benchmark, achieving higher scores with lower cost and less token bloat.
ProgramBench result for Fable 5 is in, doubling Opus 4.8 even with 4.8 fallback "99% of the runs"
ProgramBench results show Fable 5 achieving double the performance of Opus 4.8, even with fallback to 4.8 in 99% of runs.
@BenjaminDEKR: So it's just over? GPT5.6 Sol Ultra scores 91.9% on TerminalBench Coding is approaching solved, the same way arithmetic…
GPT5.6 Sol Ultra achieves 91.9% on TerminalBench coding benchmark, suggesting coding tasks are approaching solved.
@eliebakouch: we let opus 4.7 and gpt 5.5 run on the nanogpt optimizer speedrun: ~10k runs, 14k H200 hours, 23.9B tokens. opus hits 2…
AI agents (Opus 4.7 and GPT 5.5/Codex) autonomously optimized the nanoGPT speedrun optimizer, beating the human baseline with a new record of 2930 steps. The blog details their search methods, failures, and releases all run data and code.
GPT 5.6 Sol benchmarks
GPT 5.6 Sol achieves new benchmark results, showcasing performance improvements in AI language modeling.