GoBench: Evaluating LLMs on the game of Go [R]
Summary
GoBench is a benchmark for evaluating large language models on 9x9 Go games, demonstrating strong correlation with ARC-AGI and featuring a leaderboard with KataGo opponents from random to superhuman levels.
Similar Articles
XLGoBench: Detecting cross-lingual skill gaps with algorithmic tasks
XLGoBench introduces a synthetic benchmark of algorithmic tasks to detect cross-lingual skill gaps in LLMs, demonstrating persistent gaps across multiple state-of-the-art models.
Magis-Bench: Evaluating LLMs on Magistrate-Level Legal Tasks
This article introduces Magis-Bench, a benchmark for evaluating large language models on magistrate-level legal tasks such as judicial reasoning and sentence drafting, using data from Brazilian judicial exams.
Game Arena: Strategic LLM Evaluation in Competitive Environments
Game Arena is an open platform for evaluating large language models through competitive games like Chess, Poker, and Werewolf, enabling dynamic assessment of strategic planning and robustness.
Finding the Move Is Not Winning the Game: XiangqiBench for Closed-Loop Evaluation of LLM Agents
XiangqiBench is an executable benchmark for closed-loop evaluation of LLM agents in Xiangqi endgames, measuring whether models can convert forced-mate positions into verified wins against an engine defender, and revealing large gaps between static move-finding competence and actual game-winning performance across 12 frontier LLMs.
MoveBench: A Rubric-Based Benchmark for Evaluating Large Language Models in Sports and Health Coaching
MoveBench introduces the first rubric-based benchmark for evaluating large language models in sports and health coaching, covering safety, scientific validity, and personalization across multiple-choice and open-ended tasks. An evaluation of 15 LLMs on 809 questions with 5,012 rubric criteria reveals significant gaps in safety awareness and personalized program design.