"Grok 4.5 has an advantage on CursorBench: an earlier snapshot of the Cursor codebase was unintentionally included in training"

Reddit r/singularity News

Summary

CursorBench reveals that Grok 4.5's high scores were partly due to unintentional inclusion of an earlier snapshot of the Cursor codebase in its training data. The data has been removed for future models.

No content available
Original Article
View Cached Full Text

Cached at: 07/09/26, 07:51 AM

# Cursor · CursorBench Source: [https://cursor.com/cursorbench](https://cursor.com/cursorbench) We evaluate agents on ambiguous, multi\-file tasks from real Cursor sessions\. Higher scores are better\. [More about CursorBench](https://cursor.com/blog/cursorbench)A scatter and line chart comparing Fable 5, Opus 4\.8, GPT\-5\.5, Sonnet 5, Grok 4\.5, GLM 5\.2, Composer 2\.5, Gemini 3\.5 Flash, and Kimi K2\.7 Code scores against average cost per task\.75%CursorBench 3\.2 score70%65%60%55%50%45%$20$16$12$8$4$0Average cost per taskGrok 4\.5 high[\*](https://cursor.com/cursorbench#cursorbench-grok-note)Fable 5 highOpus 4\.8 highSonnet 5 highComposer 2\.5GPT\-5\.5 mediumGLM 5\.2 highKimi K2\.7 CodeGemini 3\.5 FlashModel1Fable 5 Max70\.5%$17\.32103,525722Fable 5 Extra High68\.4%$11\.7364,971563Grok 4\.5 High[\*](https://cursor.com/cursorbench#cursorbench-grok-note)66\.7%$1\.5119,521334Fable 5 High66\.5%$8\.7743,747485Grok 4\.5 Medium[\*](https://cursor.com/cursorbench#cursorbench-grok-note)65\.4%$1\.5418,914346Fable 5 Medium65\.2%$6\.8030,366417Grok 4\.5 Low[\*](https://cursor.com/cursorbench#cursorbench-grok-note)63\.5%$1\.2215,841318Opus 4\.8 Max62\.3%$5\.7771,411449Fable 5 Low62\.1%$4\.4618,1823110Sonnet 5 Max61\.5%$6\.4592,8828611Opus 4\.8 Extra High59\.4%$4\.5051,1214012Sonnet 5 Extra High58\.7%$4\.1652,8716713GPT\-5\.5 High58\.4%$2\.0512,1832814GPT\-5\.5 Extra High58\.4%$2\.8517,5343215Opus 4\.8 High58\.0%$3\.1533,5483316Sonnet 5 High56\.9%$3\.1939,4835717Opus 4\.8 Medium56\.1%$2\.8128,3843218Composer 2\.556\.1%$0\.4414,2863319GLM 5\.2 Max55\.0%$1\.7635,9465820GPT\-5\.5 Medium53\.8%$1\.518,5222521Opus 4\.8 Low53\.1%$2\.0219,6242722Sonnet 5 Medium52\.4%$2\.1626,2004623GLM 5\.2 High51\.5%$1\.1921,8294924Kimi K2\.7 Code49\.7%$1\.4331,2475825Gemini 3\.5 Flash48\.8%$2\.2046,7027726Sonnet 5 Low47\.7%$1\.3016,2693327GPT\-5\.5 Low46\.6%$0\.985,16820 Grok 4\.5 has an advantage on CursorBench: an earlier snapshot of the Cursor codebase was unintentionally included in training\. The exact score impact is unclear\. That data has been removed for future models\. For a rundown of third\-party benchmark scores, see[the Grok 4\.5 launch blog](https://cursor.com/blog/grok-4-5)\. ## Changelog ### CursorBench 3\.2 - Introduced instruction following and advanced tool use problems\. ### CursorBench 3\.1 - Introduced problems focused on codebase understanding, bugfinding, planning, and code review\. - Improved grading criteria for some edit tasks\. ### CursorBench 3\.0 - Initial set of tasks focused on edit, refactor, and bugfix problems\. Avg cost / task is computed by applying each model's published[per\-million\-token pricing](https://cursor.com/docs/models-and-pricing)\(input, cache read, cache write, and output\) to the tokens it used on each task across the CursorBench 3\.2 benchmarks, then averaging with the same task weights as the CursorBench 3\.2 score\. Results are subject to variance; small differences in scores may not be statistically meaningful\.

Similar Articles

Grok 4.5

Hacker News Top

xAI has released Grok 4.5, a new version of their AI model, as announced on Cursor's blog.

Grok 4.7 benchmarks

Reddit r/singularity

This article likely discusses the benchmark results for the Grok 4.7 AI model, comparing its performance across various tasks.

Grok 4.6

Hacker News Top

xAI releases Grok 4.6, a frontier model focused on long-running agents and ambitious interactive/visual work, matching GPT-5.6 Sol on the Artificial Analysis Intelligence Index and available in Cursor and Grok Build.

@elonmusk: Grok 4.7 moves up in ranking

X AI KOLs Following

Grok 4.7 has moved up in the SWE-Together leaderboard rankings after its weak spots were identified and fixed, leading to an audit and update of all model trials.