AREX-2: Advancing Self-Improving Agents through Long-Horizon Reflective Tasks
Summary
AREX-2 advances LLM agent self-improvement by training on synthesized long-horizon reflective trajectories from ML and algorithmic programming tasks. Built on Qwen3.8-27B, it achieves strong results on MLE-bench Lite (81.8) and Frontier-CS (70.7) and transfers to deep research tasks like BrowseComp, HLE, GAIA, and DeepSearchQA.
View Cached Full Text
Cached at: 10/01/26, 04:20 AM
Paper page - AREX-2: Advancing Self-Improving Agents through Long-Horizon Reflective Tasks
Source: https://huggingface.co/papers/2609.38288 Authors:
,
,
,
,
,
,
,
,
,
,
,
,
Abstract
WepresentAREX-2,anefforttoadvancetheself-improvingcapabilityofLLMagents,whichwedefineastheabilitytoiterativelyrefineasolutionattesttime.Thisabilityrestsontwocomplementarycapabilities:reflection,whichproducesasolutionbetterthanthecurrentone,andlong-horizonexecution,whichkeepstheiterationeffectiveovermanyrounds.Wehypothesizethatbothcapabilitiesaredomain-agnostic,andcanthereforebelearnedinscenariosthatarewellsuitedforsupervision.Accordingly,wesynthesizelong-horizonimprovementtrajectoriesfrommachinelearningandalgorithmicprogrammingtasks,twodomainsthatofferverifiablefeedbackandrewardsustainediteration.Trainedonthisdata,ouragent,builtonQwen3.8-27B,achievesstrongresultsonMLE-benchLite(81.8)andFrontier-CS(70.7),transferstodeepresearchwith84.0onBrowseComp,52.6onHLE,92.2onGAIA,and93.8onDeepSearchQA,andkeepsimprovingasitsbudgetofroundsgrows.Theseresultsshowthatlong-horizonreflectivedataisaneffectiveroutetowardself-improvingagents.
View arXiv pageView PDFProject pageGitHub10Add to collection
Get this paper in your agent:
hf papers read 2609\.38288
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2609.38288 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2609.38288 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2609.38288 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
AREX: Towards a Recursively Self-Improving Agent for Deep Research
AREX introduces a family of recursively self-improving agents for deep research, alternating between an inner research loop and an outer self-improvement loop, trained with long-horizon reinforcement learning. It substantially outperforms comparable-scale baselines on benchmarks like BrowseComp and Humanity's Last Exam.
BAAI/AREX-2 - 27B - Agent model based on Qwen3.8 27B
BAAI releases AREX-2, a 27B long-horizon self-improving agent model based on Qwen3.8 that learns to propose, measure, reflect, and revise solutions over multiple test-time rounds, achieving strong results on coding, ML engineering, and deep research benchmarks with only 27B parameters.
Retrospective Progress-Aware Self-Refinement for LLM Agent Training
This paper introduces RePro, a framework that trains LLM agents to self-generate progress signals through a forward-then-reflect rollout paradigm, achieving up to 12% absolute success rate gains on WebShop, ALFWorld, and Sokoban benchmarks.
ARISE: Practical Self-Evolving Memory for Accurate and Cost-Efficient Enterprise Agents
ARISE is a practical self-evolving memory architecture for enterprise LLM agents that refines retrievable micro corrections and macro rules from failures without updating model weights, tools, or workflow logic, achieving up to 10.9 pp accuracy gains over baselines on SOP-Bench and τ²-bench while reducing model calls and tokens.
Agent-Reflex: Teaching Language Agents to Act Reflectively
The paper proposes Agent-Reflex, a three-stage training framework (Reflection Skill Discovery, Reflective SFT, and On-Policy Reflective Policy Optimization) that teaches language agents to proactively reflect under noisy tool feedback and user interventions, achieving state-of-the-art results on long-horizon tool-use benchmarks with Qwen3-8B.