Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play
Summary
STRATAGEM is a new framework for improving reasoning transferability in language models by using game self-play with a Reasoning Transferability Coefficient and Reasoning Evolution Reward to reinforce abstract, domain-agnostic reasoning patterns over game-specific heuristics. Experiments show strong improvements on mathematical reasoning, general reasoning, and code generation benchmarks.
View Cached Full Text
Cached at: 04/21/26, 07:21 AM
Paper page - Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play
Source: https://huggingface.co/papers/2604.17696 Authors:
,
,
,
,
,
,
,
,
,
,
Abstract
STRATAGEM addresses limitations in reasoning transfer for language models by using a reasoning transferability coefficient and evolution reward to promote abstract, domain-agnostic patterns over game-specific heuristics.
Games offer a compelling paradigm for developing general reasoning capabilities in language models, as they naturally demandstrategic planning,probabilistic inference, andadaptive decision-making. However, existingself-playapproaches rely solely on terminal game outcomes, providing no mechanism to distinguish transferable reasoning patterns from game-specific heuristics. We present STRATAGEM, which addresses two fundamental barriers to reasoning transfer:domain specificity, where learned patterns remain anchored in game semantics, andcontextual stasis, where static game contexts fail to cultivate progressive reasoning. STRATAGEM selectively reinforces trajectories exhibiting abstract, domain-agnostic reasoning through aReasoning Transferability Coefficient, while incentivizing adaptive reasoning development via aReasoning Evolution Reward. Experiments across mathematical reasoning, general reasoning, and code generation benchmarks demonstrate substantial improvements, with particularly strong gains on competition-level mathematics wheremulti-step reasoningis critical. Ablation studies and human evaluation confirm that both components contribute to transferable reasoning.
View arXiv pageView PDFGitHub0Add to collection
Get this paper in your agent:
hf papers read 2604\.17696
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2604.17696 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2604.17696 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2604.17696 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models
This paper introduces GENSTRAT, a benchmark that uses procedurally generated strategic environments to evaluate LLMs' strategic reasoning across multiple axes, addressing limitations of fixed game suites.
Efficient Agentic Reasoning Through Self-Regulated Simulative Planning
Introduces SR²AM, a framework for efficient agentic reasoning via self-regulated simulative planning, achieving competitive performance with models 20-30x larger while using 26-95% fewer reasoning tokens.
Beyond Trajectory Imitation: Strategy-Guided Policy Optimization for LLM Reasoning
Introduces Strategy-Guided Policy Optimization (SGPO) for LLM reasoning, which replaces trajectory imitation with strategy distillation, improving generalization on math benchmarks.
STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue Systems
STRIDE-ED is a strategy-grounded reasoning framework for empathetic dialogue systems that uses structured multi-stage reasoning combined with a data refinement pipeline and two-stage training (supervised fine-tuning + multi-objective RL) to improve emotional understanding and response generation. The framework demonstrates consistent improvements across open-source LLMs on both automatic metrics and human evaluations.
Reasoning that Travels: Dissecting How Chain-of-Thought Transfers Across Models
This paper studies how chain-of-thought reasoning traces transfer across different models, using a controlled provider–receiver framework to dissect the mechanisms behind successful transfer.