AREX-2: Advancing Self-Improving Agents through Long-Horizon Reflective Tasks

Hugging Face Daily Papers Papers

Summary

AREX-2 advances LLM agent self-improvement by training on synthesized long-horizon reflective trajectories from ML and algorithmic programming tasks. Built on Qwen3.8-27B, it achieves strong results on MLE-bench Lite (81.8) and Frontier-CS (70.7) and transfers to deep research tasks like BrowseComp, HLE, GAIA, and DeepSearchQA.

We present AREX-2, an effort to advance the self-improving capability of LLM agents, which we define as the ability to iteratively refine a solution at test time. This ability rests on two complementary capabilities: reflection, which produces a solution better than the current one, and long-horizon execution, which keeps the iteration effective over many rounds. We hypothesize that both capabilities are domain-agnostic, and can therefore be learned in scenarios that are well suited for supervision. Accordingly, we synthesize long-horizon improvement trajectories from machine learning and algorithmic programming tasks, two domains that offer verifiable feedback and reward sustained iteration. Trained on this data, our agent, built on Qwen3.8-27B, achieves strong results on MLE-bench Lite (81.8) and Frontier-CS (70.7), transfers to deep research with 84.0 on BrowseComp, 52.6 on HLE, 92.2 on GAIA, and 93.8 on DeepSearchQA, and keeps improving as its budget of rounds grows. These results show that long-horizon reflective data is an effective route toward self-improving agents.
Original Article
View Cached Full Text

Cached at: 10/01/26, 04:20 AM

Paper page - AREX-2: Advancing Self-Improving Agents through Long-Horizon Reflective Tasks

Source: https://huggingface.co/papers/2609.38288 Authors:

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

WepresentAREX-2,anefforttoadvancetheself-improvingcapabilityofLLMagents,whichwedefineastheabilitytoiterativelyrefineasolutionattesttime.Thisabilityrestsontwocomplementarycapabilities:reflection,whichproducesasolutionbetterthanthecurrentone,andlong-horizonexecution,whichkeepstheiterationeffectiveovermanyrounds.Wehypothesizethatbothcapabilitiesaredomain-agnostic,andcanthereforebelearnedinscenariosthatarewellsuitedforsupervision.Accordingly,wesynthesizelong-horizonimprovementtrajectoriesfrommachinelearningandalgorithmicprogrammingtasks,twodomainsthatofferverifiablefeedbackandrewardsustainediteration.Trainedonthisdata,ouragent,builtonQwen3.8-27B,achievesstrongresultsonMLE-benchLite(81.8)andFrontier-CS(70.7),transferstodeepresearchwith84.0onBrowseComp,52.6onHLE,92.2onGAIA,and93.8onDeepSearchQA,andkeepsimprovingasitsbudgetofroundsgrows.Theseresultsshowthatlong-horizonreflectivedataisaneffectiveroutetowardself-improvingagents.

View arXiv pageView PDFProject pageGitHub10Add to collection

Get this paper in your agent:

hf papers read 2609\.38288

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2609.38288 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2609.38288 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.38288 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

AREX: Towards a Recursively Self-Improving Agent for Deep Research

Hugging Face Daily Papers

AREX introduces a family of recursively self-improving agents for deep research, alternating between an inner research loop and an outer self-improvement loop, trained with long-horizon reinforcement learning. It substantially outperforms comparable-scale baselines on benchmarks like BrowseComp and Humanity's Last Exam.

BAAI/AREX-2 - 27B - Agent model based on Qwen3.8 27B

Reddit r/LocalLLaMA

BAAI releases AREX-2, a 27B long-horizon self-improving agent model based on Qwen3.8 that learns to propose, measure, reflect, and revise solutions over multiple test-time rounds, achieving strong results on coding, ML engineering, and deep research benchmarks with only 27B parameters.

Agent-Reflex: Teaching Language Agents to Act Reflectively

Hugging Face Daily Papers

The paper proposes Agent-Reflex, a three-stage training framework (Reflection Skill Discovery, Reflective SFT, and On-Policy Reflective Policy Optimization) that teaches language agents to proactively reflect under noisy tool feedback and user interventions, achieving state-of-the-art results on long-horizon tool-use benchmarks with Qwen3-8B.