Tag
MiMo-V2.6 is a large-scale reinforcement learning model that has become the top open-source model, with research innovations surpassing DeepSeek R1 and resources released to advance Agentic RL research.
Introducing Skill2Env, an aligned and diverse dataset designed to fuel modern Agentic Reinforcement Learning research.
EnvCraft is an automated framework for synthesizing executable environments to address the scarcity in Agentic RL training, showing significant performance gains on claw-like and general tool-use benchmarks using Qwen models.
Agent Lightning v1.0 is a lightweight agentic reinforcement learning framework by Microsoft, refactored for training AI agents with real harnesses and achieving substantial benchmark improvements, such as a 14.6 percentage point gain on SWE-bench.
TideRL is a readiness-aware elastic RL system that improves training goodput for multi-turn agentic workloads via continuous task batching, resource-aware ref-actor pipelining, and elastic resource scaling, achieving up to 5.6x speedup over synchronous baselines and 33% over asynchronous baselines.
This paper introduces EFCA, a multi-timescale credit assignment method for agentic reinforcement learning that uses short-term feedback and medium-term state-history signals from environment interaction to improve task success and quality on ALFWorld and WebShop.
AgentOPSD proposes a critic-free recursive method for turn-level credit assignment in agentic RL, reweighting outcomes via Bayesian belief updates in log-odds space. It achieves 89.1% success on ALFWorld with Qwen2.5-7B, outperforming GRPO and self-distillation baselines.
EnvACE introduces world rehearsal, an agentic reinforcement learning method that replaces external environment interaction by having the policy rehearse environment responses internally, achieving strong performance across multiple benchmarks.
This paper introduces SciDisco, a scalable framework for training scientific discovery agents via process-verifiable environments, DAG-grounded trajectory synthesis, and turn-level reinforcement learning. The proposed SciDisco-14B model achieves state-of-the-art on hypothesis-driven scientific data analysis benchmarks.
SkillRise is a unified reinforcement learning framework that enables LLM agents to learn and reuse skills across related, progressively challenging tasks, outperforming baselines by up to 8.5 percentage points on several benchmarks.
Molt is an open-source, PyTorch-native agentic RL framework from NVIDIA NeMo, designed for scalable, fully-async training of large multimodal agent models using Ray, vLLM, and NVIDIA AutoModel.
NVIDIA released Molt, a PyTorch-native agentic RL framework designed for compactness and readability, with performance comparable to Megatron-based stacks. The framework is open-source and includes a paper.
Molt is a PyTorch-native training framework for agentic reinforcement learning designed to be compact and clean for easy modification, while achieving performance comparable to Megatron-based stacks.
Google announces a major update to Tunix, its post-training library, with an asynchronous decoupled rollout engine to scale agentic reinforcement learning on JAX/TPU, eliminating idle time and improving throughput.
ToolVerse is a framework that automatically builds massive executable agent training environments from 422 real-world MCP environments containing 4438 tools, and proposes a task design strategy using Dynamic Unlocking Sampling Algorithm to generate long-horizon tasks, along with a Turn-Aware Relative Advantage algorithm for credit assignment in agentic reinforcement learning.
This paper investigates the use of the Muon optimizer in reinforcement learning post-training, finding that applying Muon to hidden weight matrices significantly improves success rates on ALFRED tasks compared to AdamW, with results dependent on the advantage estimator and learning rate.
This paper from Tsinghua University introduces Single-rollout Asynchronous Optimization (SAO) for reinforcement learning post-training of LLMs. SAO replaces batch-based GRPO with single-rollout asynchronous training to reduce idle GPU time and improve stability, and it was used to train the GLM-5.2 model (750B-A40B), achieving state-of-the-art results on agentic coding and reasoning benchmarks.
The paper introduces Single-rollout Asynchronous Optimization (SAO) to address stability and off-policy challenges in asynchronous RL for LLM post-training, and demonstrates that SAO consistently outperforms GRPO on agentic coding and reasoning benchmarks.
Tsinghua's SAO algorithm addresses stability and off-policy drift in asynchronous reinforcement learning for LLMs, achieving consistent improvements over GRPO on agentic coding and reasoning benchmarks, and is used to train the GLM-5.2 model.
This paper presents Single-rollout Asynchronous Optimization (SAO) to address stability and off-policy challenges in asynchronous RL for agentic tasks, outperforming GRPO and its variants on coding and reasoning benchmarks. SAO is deployed in the GLM-5.2 model's agentic RL pipeline.