Efficient Agentic Reasoning Through Self-Regulated Simulative Planning

Hugging Face Daily Papers Papers

Summary

Introduces SR²AM, a framework for efficient agentic reasoning via self-regulated simulative planning, achieving competitive performance with models 20-30x larger while using 26-95% fewer reasoning tokens.

How should an agent decide when and how to plan? A dominant approach builds agents as reactive policies with adaptive computation (e.g., chain-of-thought), trained end-to-end expecting planning to emerge implicitly. Without control over the presence, structure, or horizon of planning, these systems dramatically increase reasoning length, yielding inefficient token use without reliable accuracy gains. We argue efficient agentic reasoning benefits from decomposing decision-making into three systems: simulative reasoning (System II) grounding deliberation in future-state prediction via a world model; self-regulation (System III) deciding when and how deeply to plan via a learned configurator; and reactive execution (System I) handling fine-grained action. Simulative reasoning provides unified planning across diverse tasks without per-domain engineering, while self-regulation ensures the planner is invoked only when needed. To test this, we develop SR^2AM (Self-Regulated Simulative Reasoning Agentic LLM), realizing both as distinct stages within an LLM's chain-of-thought, with the LLM as world model. We explore two instantiations: recording decisions from a prompted multi-module system (v0.1) and reconstructing structured plans from traces of pretrained reasoning LLMs (v1.0), trained via supervised then reinforcement learning (RL). Across math, science, tabular analysis, and web information seeking, v0.1-8B and v1.0-30B achieve Pass@1 competitive with 120-355B and 685B-1T parameter systems respectively, while v1.0-30B uses 25.8-95.3% fewer reasoning tokens than comparable agentic LLMs. RL increases average planning horizon by 22.8% while planning frequency grows only 2.0%, showing it learns to plan further ahead rather than more often. More broadly, learned self-regulation instantiates a principle we expect to extend beyond planning to how agents govern their own learning and adaptation.
Original Article
View Cached Full Text

Cached at: 05/22/26, 06:21 PM

Paper page - Efficient Agentic Reasoning Through Self-Regulated Simulative Planning

Source: https://huggingface.co/papers/2605.22138 Efficient reasoning isnotabout shorter chain-of-thought, but about betterallocationof simulation (i.e., knowing when to imagine possible futures and when to act directly).

Current adaptive-reasoning approaches (effort knobs, token budgets in Opus 4.7 and GPT-5.5) control how much the model thinks. SR²AM asks a more structural question: whatkind of thinkingshould the model do at each step?

We decompose agentic deliberation into three systems:

  • System I (reactive execution): fast, pattern-based reasoning and action for familiar situations
  • System II (simulative reasoning): predicting future states through the a world model, evaluating consequences before committing. This is what separates planning from longer chain-of-thought
  • System III (self-regulation): a learned configurator that autonomously decides when to simulate, how far ahead, and when to skip planning entirely

Last year, in our companion paperSiRA, we showed that simulative reasoning yields up to 124% improvement over reactive baselines — and that strong reasoning models (o1, o3-mini) fail as planners without this structure.

SR²AMadds the self-regulation layer. The result is RL enables the model to plan further ahead (+22.8% horizon) rather than more often (+2% frequency). In terms of performance, our 30B model is competitive with DeepSeek-V3.2 (685B) and Kimi-K2.5 (1T) at 26–95% fewer reasoning tokens.

This is a prototype using language-based world models. Stay tuned for our next steps on multimodal and physical world models.

The concept of a configurator, which decides when and how deeply to engage a reasoning process, is not specific to planning, but extensible to learning and adaptation going forward.

📄 SR²AM:https://arxiv.org/abs/2605.22138 📄 SiRA:https://arxiv.org/abs/2507.23773 🌐 Project:https://sailing-lab.github.io/sr2am-self-regulated-planning 💻 Code:https://github.com/sailing-lab/sr2am

🤗 SR²AM-v0.1-8B:https://huggingface.co/sailing-lab/SR2AM-v0.1-8B 🤗 SR²AM-v1.0-30B:https://huggingface.co/sailing-lab/SR2AM-v1.0-30B

Similar Articles

Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Play

Hugging Face Daily Papers

STRATAGEM is a new framework for improving reasoning transferability in language models by using game self-play with a Reasoning Transferability Coefficient and Reasoning Evolution Reward to reinforce abstract, domain-agnostic reasoning patterns over game-specific heuristics. Experiments show strong improvements on mathematical reasoning, general reasoning, and code generation benchmarks.

SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent

Hugging Face Daily Papers

This paper proposes SAM, a state-adaptive memory framework that dynamically manages interaction histories for long-horizon agentic reasoning, enabling intent-driven recall without retraining the backbone model. It outperforms strong baselines across multiple benchmarks like BrowseComp and HLE.