Muse Wonder (high) scores 1.96 on the Short Story Creative Writing Benchmark, compared with 0.56 for Muse Spark 1.3 (high). Gemini 4 Argon (high) scores 0.80, up from −2.17 for Gemini 3.1 Pro Preview.

Reddit r/singularity News

Summary

Gemini 4 Argon dramatically outperforms Gemini 3.1 Pro Preview on a creative writing benchmark (0.80 vs -2.17), winning all 50 matched story comparisons, while Muse Wonder scores 1.96 versus 0.56 for Muse Spark 1.3. The leaderboard covers 59 writer models with over 110,000 judgments from cross-family judges.

https://github.com/lechmazur/writing/ Argon's improvement over Gemini 3.1 Pro is large. It won all 50 matched story comparisons. Required objects, abilities, and constraints more often affect what happens in the story. Characters' solutions have clearer preparation and consequences, and relationships more often involve reciprocal needs. Gemini 3.1 Pro more frequently supplies symbolic ingredients and then explains that the problem has been solved. Argon still has recognizable habits: repeated names, explanatory narration, and endings that resolve emotional conflict too neatly. Stronger construction has not eliminated repetition or made its writing consistently subtle. https://github.com/lechmazur/writing/blob/main/reports/pair_analysis/gemini-4-argon-high__vs__gemini-3.1-pro-preview__comparator_v2_eval_v4_gemini_argon_vs_gemini31_20261013_n50__subjective_v5_habits_range.md The Creative Writing Benchmark tests how well models turn constrained briefs into complete 600-800-word stories. Each brief specifies 10 required elements, including a character, object, setting, motivation, and tone, that must meaningfully shape the story. Judges assess prose, originality, coherence, characterization, and how effectively the required elements work together. Models write to the same prompts. The comparisons use three judges from different model families, excluding both writers' families. Each story pair is judged in both presentation orders to reduce position bias. The leaderboard covers 59 writer models and 110,748 evaluator judgments.
Original Article

Similar Articles