19 LLMs played 376 games of a word-association game against each other. The team with the better guesser won 68% of the time, the one with better clues only 53%
Summary
A developer built a Codenames-inspired browser game where LLMs play each other, running 376 games across 19 models and finding that guesser quality (68% win correlation) matters far more than clue quality (53%), with newer models guessing much better than older ones. Raw data and replayable games are shared publicly.
Similar Articles
Can LLM Teams Play What? Where? When?
This paper investigates whether team-based interaction improves LLM performance in the quiz game 'What? Where? When?' (ChGK). Using six recent open LLMs on a 2025 dataset of 572 questions, they show that team strategies (voting, silent captain, talkative captain) outperform single models by up to 20 percentage points, with the best team achieving 44.23% accuracy, approaching human performance.
Evaluating open source LLMs on Autonomous Codenames Simulations
A developer built a Codenames simulation arena to evaluate open-source LLMs on long-range collaboration, finding DeepSeek v4 Flash outperformed others with high game logic alignment, while Qwen 3 Next and GPT 5.4 Nano struggled with rule constraints and perspective-taking.
@LM_Braswell: Confirmed LLMs now much better than room of avid Anagram players - can you figure out where to put the last I?
LLMs now outperform a room of proficient anagram players, as demonstrated in a recent evaluation.
Age of LLM: A Strategic 1v1 Benchmark for Reasoning, Diplomacy and Reliability of Large Language Models under Fog of War
Introduces Age of LLM, a turn-based 1v1 benchmark where LLMs compete on a grid with fog of war and diplomacy, measuring reasoning, reliability, and strategic planning. Findings show a dominance of nuclear rush tactics and a weak link between reliability and winning.
I built a 1v1 nuclear strategy game to benchmark LLM reasoning (instead of just QCMs) — Age of LLM
A new open-source benchmark called Age of LLM tests LLM reasoning through a turn-based nuclear strategy game with fog of war, diplomacy, and bluffing, offering a more dynamic evaluation than traditional multiple-choice benchmarks.