Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning

# Know What You Don’t Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning
Source: [https://arxiv.org/html/2610.12593](https://arxiv.org/html/2610.12593)
Wei Yang††thanks:Work was done during an internship at AWS AI\.Qing PingAffiliation:AWS AIYouzhi LuoAffiliation:AWS AIYawei WangAffiliation:AWS AIAbhishek KumarAffiliation:AWS AIPanpan XuAffiliation:AWS AIJun HuanAffiliation:AWS AI

###### Abstract

The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent\. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a*feedback\-to\-decision gap*: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space\. To address this gap, we proposeEvoSyn, a learning\-feedback\-driven multi\-agent framework that organizes synthesis around a revisable state specifying*what*interaction factors can be deliberately generated and*where*synthesis effort should be allocated\. A role\-specialized multi\-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience\. This process enables*within\-space adaptation*toward weak or under\-covered regions and*synthesis\-space expansion*that promotes newly discovered factors into explicit generation controls\. Experiments onτ2\\tau^\{2\}\-Bench and CAR\-Bench show thatEvoSynimproves average task success by13\.313\.3points over the strongest synthesis baseline, while producing higher\-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback\.

## 1Introduction

Synthetic data has become a central mechanism for pushing large language models beyond the limits of human annotation\([Wang et al\., 2023](https://arxiv.org/html/2610.12593#bib.bib31);[Xu et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib35);[Shao et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib22)\)\. In reasoning domains, a synthetic example can often be formulated as a self\-contained problem with a verifiable answer or solution trace, allowing synthesis to focus on concepts or reasoning patterns the model has not yet mastered\([Gou et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib8);[Li et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib13)\)\. Interactive agents impose an additional challenge\([Pahuja et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib19);[Wang et al\., 2026b](https://arxiv.org/html/2610.12593#bib.bib32)\)\. A valid agentic example must be feasible in an environment, executable through tools, consistent with domain policies, and verifiable through state changes or task outcomes\([Chen et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib2);[Wang et al\., 2026b](https://arxiv.org/html/2610.12593#bib.bib32)\)\. Yet validity alone does not implylearning utility\. An executable and correct task may simply repeat behavior the current agent already handles, while interactions that expose its remaining weaknesses remain absent from training\([Huang et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib11);[Liang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib16)\)\. Thus, the central question in agentic data synthesis is not simply how to generate valid tasks, butwhat interactions are most useful for the current learner to experience next\.

Recent work has made substantial progress toward feedback\-driven synthesis\([Chen et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib3);[Liang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib16)\)\. Environment\-grounded methods such as AutoPlay\([Ramrakhya et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib21)\)and Trajectory2Task\([Wang et al\., 2026b](https://arxiv.org/html/2610.12593#bib.bib32)\)use interaction feedback to construct executable tasks; data\-centric methods such as EigenData\([Chen et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib2)\)audit and repair generated samples; and learner\-adaptive methods such as R\-Zero\([Huang et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib11)\)and Socratic\-Zero\([Wang et al\., 2025b](https://arxiv.org/html/2610.12593#bib.bib30)\)generate new problems from model failures or capability boundaries\. These methods improve feasibility, data quality, and learner adaptivity, but using feedback is not the same as knowing what synthesis decision it should support\. A common implicit assumption is that the learner’s remaining weaknesses are already expressible within the current synthesis space, such as predefined task categories or interaction dimensions\. Yet observed failures are not themselves actionable synthesis coordinates: they reveal where the learner struggles without necessarily identifying which interaction factors should be controlled in future generation\([Yang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib37);[Kwan et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib12)\)\. We refer to this missing bridge as thefeedback\-to\-decision gap: translating learner feedback into actionable synthesis decisions while determining whether the current synthesis space can represent the learner’s remaining weaknesses\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/evosyn_intro1.png)Figure 1:From static synthesis to closed\-loop self\-evolving agentic synthesis\. Existing paradigms improve data quality or adapt within a fixed synthesis space\. In contrast,EvoSynuses learner feedback to revise both the allocation over known factors and the synthesis space itself by introducing new controllable interaction factors\.As illustrated in Figure[1](https://arxiv.org/html/2610.12593#S1.F1), closing this gap requires the synthesis process itself to evolve together with the task agent\([Cheng et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib4)\)\. Learner feedback can expose two fundamentally different forms of mismatch\. When the learner’s weakness is already expressible in the current synthesis space, the problem is one ofwithin\-space adaptation: synthesis effort should be reallocated toward under\-covered or challenging regions\([Yue et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib41)\)\. When the weakness is not captured by existing synthesis coordinates, reallocation alone is insufficient; the system must instead performsynthesis\-space expansion, promoting previously unrepresented but actionable interaction factors into explicit controls for future generation\([Li et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib15)\)\. For example, failures on refund or flight\-change tasks may actually stem from numerical computation, policy\-dependent action ordering, or the coordination of multiple state\-changing operations\. If such factors are absent from the synthesis space, generating more examples from the same task categories may increase data volume without addressing the underlying capability gap\. Self\-evolving agentic synthesis should therefore adapt not only the distribution over what can already be generated, but also the representation of what can be generated at all\.

To address these challenges, we proposeEvoSyn, a learning\-feedback\-driven multi\-agent framework for self\-evolving agentic data synthesis\.EvoSynorganizes generation around a structured and revisable synthesis space over controllable interaction factors, which serves both as a coordinate system for learner diagnosis and as a control surface for future generation\. Within this space, a Designer Agent selects synthesis directions and allocates generation budget, while a Planner Agent grounds these directions into environment\-consistent task blueprints\. A Generator Agent and rollout teacher then instantiate executable tasks and successful trajectories, which are further filtered by a Verifier Agent to ensure valid supervision\. After task\-agent training, a Reflector Agent analyzes performance, coverage, and failure signals and maps them back to the synthesis space\. This feedback drives eitherwithin\-space adaptation, which reallocates synthesis effort over existing coordinates, orsynthesis\-space expansion, which introduces new evidence\-grounded and actionable factors as future generation controls\. Through this closed loop,EvoSynenables the task agent and its synthesis space to co\-evolve through learning feedback\.

Our main contributions are as follows:

- •We identify afeedback\-to\-decision gapin self\-evolving agentic data synthesis and formulate self\-evolving synthesis over arevisable synthesis spacethat adapts with the learner\.
- •We proposeEvoSyn, which combineswithin\-space adaptationto reallocate synthesis effort over existing factors withsynthesis\-space expansionto introduce new actionable factors revealed by learner feedback\.
- •Experiments onτ2\\tau^\{2\}\-Bench and CAR\-Bench improve average task success by13\.313\.3points over the strongest synthesis baseline, while analyses show that learner feedback drives allocation shifts and reveals useful synthesis factors missed without it\.

## 2Related Work

Synthetic Data for Self\-Evolution\.Synthetic data has become increasingly important for LLM post\-training, as it enables models to improve beyond the scale and coverage of manually annotated supervision\. Prior work in this area can be viewed along a progression from offline data construction to learner\-aware synthesis\. Early methods generate instruction\-following or reasoning corpora from seed demonstrations, teacher models, unlabeled corpora, or problem transformations, including instruction synthesis, instruction evolution, and mathematical data augmentation\([Wang et al\., 2023](https://arxiv.org/html/2610.12593#bib.bib31);[Xu et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib35);[Li et al\., 2023](https://arxiv.org/html/2610.12593#bib.bib14);[Yu et al\., 2023](https://arxiv.org/html/2610.12593#bib.bib39);[Luo et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib17)\)\. Another line of work emphasizes verifiability and data quality, using answer checkers, tool\-integrated traces, filtering, or curated large\-scale reasoning pipelines to ensure that generated supervision can reliably support post\-training\([Zelikman et al\., 2022](https://arxiv.org/html/2610.12593#bib.bib42);[Gou et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib8);[Shao et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib22);[Li et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib13)\)\. More recent self\-evolving methods place data generation and model learning in a feedback loop, where solver failures, teacher diagnoses, or capability boundaries are used to generate increasingly challenging tasks\([Huang et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib11);[Wang et al\., 2025b](https://arxiv.org/html/2610.12593#bib.bib30);[Yue et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib41);[Kwan et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib12)\)\.

Feedback\-Driven Agentic Data Synthesis\.Synthetic data for interactive agents introduces additional requirements beyond problem–answer correctness: tasks must be feasible in an environment, executable through tools, consistent with domain policies, and verifiable through state changes or task outcomes\. Existing work addresses these requirements through several complementary forms of feedback\. Environment\-grounded methods use exploration, state replay, or valid trajectories to construct executable tasks and broaden interaction coverage\([Pahuja et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib19);[Sun et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib24);[Ramrakhya et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib21);[Wang et al\., 2026b](https://arxiv.org/html/2610.12593#bib.bib32);[Wang et al\., 2026a](https://arxiv.org/html/2610.12593#bib.bib29)\)\. Data\-centric methods use checkers, validators, rejection reasons, or learned experience models to improve the validity and quality of tool\-use or multi\-turn synthetic data\([Chen et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib2);[Chen et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib3)\)\. A further group of agent\-evolution frameworks studies how environments, curricula, workflows, memories, or tool\-use experiences can be revised over time\([Yang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib37);[Dong et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib6);[Dai et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib5);[Zhai et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib43);[Wu et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib33);[Zhang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib44)\)\. These directions collectively establish the importance of feedback in agentic data generation, while leaving open how different feedback signals should be converted into reusable synthesis decisions rather than only valid instances, repaired samples, or broader trajectory collections\. We provide a more complete discussion of related work in Appendix[A\.2](https://arxiv.org/html/2610.12593#A1.SS2)and[C](https://arxiv.org/html/2610.12593#A3)\.

## 3Problem Formulation

We study synthetic data generation for improving language\-model agents in interactive tool\-use environments\. Letℰ\\mathcal\{E\}denote an environment with domain policies, tool interfaces, state constraints, and an automatic evaluator, and letπθr\\pi\_\{\\theta\_\{r\}\}denote the task agent at synthesis roundrr\. At each round, the synthesis process generates a verified dataset𝒟r\\mathcal\{D\}\_\{r\}of executable and successful task–trajectory pairs, which is used to update the task agent:

πθr\+1=Train⁡\(πθr,𝒟≤r\),𝒟≤r=⋃t=1r𝒟t\.\\pi\_\{\\theta\_\{r\+1\}\}=\\operatorname\{Train\}\\left\(\\pi\_\{\\theta\_\{r\}\},\\mathcal\{D\}\_\{\\leq r\}\\right\),\\qquad\\mathcal\{D\}\_\{\\leq r\}=\\bigcup\_\{t=1\}^\{r\}\\mathcal\{D\}\_\{t\}\.\(1\)Unlike one\-pass synthesis, however, the utility of𝒟r\\mathcal\{D\}\_\{r\}depends on the current learner: valid data may provide little learning signal if it does not target the interaction patterns where the agent remains weak\. We therefore characterize synthesis at roundrrby a*revisable synthesis state*Sr=\(𝒪r,αr\)S\_\{r\}=\(\\mathcal\{O\}\_\{r\},\\alpha\_\{r\}\), where the synthesis space𝒪r\\mathcal\{O\}\_\{r\}specifies*what interaction properties can be deliberately synthesized*, andαr\\alpha\_\{r\}specifies*where synthesis effort is allocated within that space*\. After training and evaluation, learner feedbackFrF\_\{r\}must be translated into a new synthesis state,Sr\+1=Ψ⁡\(Sr,Fr\)=\(𝒪r\+1,αr\+1\),S\_\{r\+1\}=\\Psi\(S\_\{r\},F\_\{r\}\)=\(\\mathcal\{O\}\_\{r\+1\},\\alpha\_\{r\+1\}\),whereΨ\\Psidenotes the feedback\-driven synthesis revision process\. This mapping captures the feedback\-to\-decision gap: observed learner behavior must be converted into actionable decisions\. A complete formulation is provided in Appendix[A\.1](https://arxiv.org/html/2610.12593#A1.SS1)\.

## 4Method

EvoSynis a multi\-agent framework for learning\-guided, self\-evolving agentic data synthesis\. As illustrated in Figure[2](https://arxiv.org/html/2610.12593#S4.F2), it maintains a revisable synthesis state that guides grounded data generation and is updated from learner feedback, forming a closed synthesis–learning loop\. Additional details of the complete closed\-loop framework are provided in Appendix[A\.3](https://arxiv.org/html/2610.12593#A1.SS3)\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/evosyn_main7.png)Figure 2:Overview ofEvoSyn\. Each round instantiates a closed\-loop synthesis–learning process in which a revisable synthesis state mediates learner diagnosis and generation control, role\-specialized agents realize verified experience, and feedback drives within\-space adaptation or synthesis\-space expansion to co\-evolve synthesis with task\-agent learning\.### 4\.1Revisable Environment\-Grounded Synthesis Space

The synthesis stateSr=\(𝒪r,αr\)S\_\{r\}=\(\\mathcal\{O\}\_\{r\},\\alpha\_\{r\}\)requires a structured representation of what experience can be deliberately generated\. Because agentic tasks must respect tool preconditions, domain policies, environment states, and evaluator requirements,EvoSyninstantiates𝒪r\\mathcal\{O\}\_\{r\}as a*revisable environment\-grounded synthesis space*over controllable interaction factors\. Formally,

𝒪r=\{d1r,…,dmrr\},djr=\(kjr,Vjr,cjr\),\\mathcal\{O\}\_\{r\}=\\left\\\{d\_\{1\}^\{r\},\\ldots,d\_\{m\_\{r\}\}^\{r\}\\right\\\},\\qquad d\_\{j\}^\{r\}=\\left\(k\_\{j\}^\{r\},V\_\{j\}^\{r\},c\_\{j\}^\{r\}\\right\),\(2\)wherekjrk\_\{j\}^\{r\}denotes the factor name,VjrV\_\{j\}^\{r\}its finite set of admissible values, andcjrc\_\{j\}^\{r\}specifies how the factor constrains or guides generation\. Typical factors include task intent, policy requirements, tool\-use patterns, expected outcomes, and execution complexity, while𝒪1\\mathcal\{O\}\_\{1\}is initialized from environment priors such as tool schemas, domain policies, state constraints, task specifications, and evaluator requirements\.

A*synthesis direction*specifies a controllable region of this space:

z=\{kjr=vj\}j∈ℐ,vj∈Vjr,z=\\left\\\{k\_\{j\}^\{r\}=v\_\{j\}\\right\\\}\_\{j\\in\\mathcal\{I\}\},\\qquad v\_\{j\}\\in V\_\{j\}^\{r\},\(3\)whereℐ⊆\{1,…,mr\}\\mathcal\{I\}\\subseteq\\\{1,\\ldots,m\_\{r\}\\\}andz∈𝒵⁡\(𝒪r\)z\\in\\mathcal\{Z\}\(\\mathcal\{O\}\_\{r\}\)represents a high\-level interaction target rather than a concrete task\. The Designer operates over such directions when allocating synthesis effort, while the Planner grounds each selected direction into an environment\-consistent task blueprint\.

Importantly,𝒪r\\mathcal\{O\}\_\{r\}serves as a shared representation for both*learner diagnosis*and*generation control*: its coordinates provide an interpretable basis for measuring learner performance and data coverage, while also specifying interaction properties that can be deliberately targeted in future synthesis\. The space is therefore revisable: when current coordinates are sufficient,EvoSynupdatesαr\\alpha\_\{r\}to redistribute synthesis effort; when learner feedback reveals a capability\-relevant property outside the current representation, it expands𝒪r\\mathcal\{O\}\_\{r\}with a new controllable factor\.

### 4\.2Feedback\-Guided Synthesis Evolution

The role of learning feedback inEvoSynis not merely to identify failed examples, but to determine how the synthesis process itself should change\. After each round of task\-agent training, we summarize learner behavior and synthesized experience as

Fr=Feedback⁡\(πθr\+1,𝒟≤r,𝒪r,ℰ\),F\_\{r\}=\\operatorname\{Feedback\}\\left\(\\pi\_\{\\theta\_\{r\+1\}\},\\mathcal\{D\}\_\{\\leq r\},\\mathcal\{O\}\_\{r\},\\mathcal\{E\}\\right\),\(4\)whereFrF\_\{r\}combines*performance*,*coverage*, and*failure\-diagnostic*signals\. Performance identifies weak interaction regions, coverage reveals whether these regions have received sufficient synthesis effort, and failure diagnostics capture recurrent patterns that may not yet correspond to existing synthesis coordinates\. A Reflector Agent converts this evidence into the next synthesis state:

\(𝒪r\+1,αr\+1\)=Reflector⁡\(𝒪r,αr,Fr\)\.\\left\(\\mathcal\{O\}\_\{r\+1\},\\alpha\_\{r\+1\}\\right\)=\\operatorname\{Reflector\}\\left\(\\mathcal\{O\}\_\{r\},\\alpha\_\{r\},F\_\{r\}\\right\)\.\(5\)Rather than repairing individual failures, the Reflector operates at the synthesis level, deciding whether the observed weakness can be addressed within the current synthesis space or requires revising the space itself\.

##### Within\-Space Adaptation\.

When the learner’s weakness is already expressible by factors in𝒪r\\mathcal\{O\}\_\{r\},EvoSynkeeps the synthesis space fixed and updates only the allocation:

𝒪r\+1=𝒪r,αr\+1=Reallocate⁡\(αr,Fr,𝒪r\)\.\\mathcal\{O\}\_\{r\+1\}=\\mathcal\{O\}\_\{r\},\\qquad\\alpha\_\{r\+1\}=\\operatorname\{Reallocate\}\\left\(\\alpha\_\{r\},F\_\{r\};\\mathcal\{O\}\_\{r\}\\right\)\.\(6\)The Reflector shifts synthesis effort toward directions with poor performance or insufficient coverage, while reducing effort on well\-covered or saturated regions\. The resulting allocation is then realized by the Designer Agent in the next synthesis round\.

##### Synthesis\-Space Expansion\.

When recurrent failures reveal a capability\-relevant property that is not adequately represented in𝒪r\\mathcal\{O\}\_\{r\}, reallocation alone is insufficient\. The Reflector instead identifies candidate interaction factors from diagnostic patterns in learner failures and synthesized trajectories\. A factor is promoted only if it is*evidence\-grounded*,*interpretable and finite\-valued*,*non\-redundant*with existing coordinates, and*actionable*by the downstream synthesis process\. For an accepted factordnew=\(knew,Vnew,cnew\)d\_\{\\mathrm\{new\}\}=\(k\_\{\\mathrm\{new\}\},V\_\{\\mathrm\{new\}\},c\_\{\\mathrm\{new\}\}\), the synthesis space is expanded as

𝒪r\+1=𝒪r∪\{dnew\}\.\\mathcal\{O\}\_\{r\+1\}=\\mathcal\{O\}\_\{r\}\\cup\\left\\\{d\_\{\\mathrm\{new\}\}\\right\\\}\.\(7\)The new factor becomes an explicit synthesis coordinate that can be measured, budgeted for, and deliberately instantiated in subsequent rounds\.

Together, these two updates allowEvoSynto adapt both*where*synthesis effort is placed and, when necessary,*what*the synthesis process can explicitly represent\.

### 4\.3Role\-Specialized Multi\-Agent Synthesis

The synthesis stateSr=\(𝒪r,αr\)S\_\{r\}=\(\\mathcal\{O\}\_\{r\},\\alpha\_\{r\}\)specifies what interaction factors should be targeted and how synthesis effort should be distributed, but it does not directly define executable training examples\.EvoSyntherefore uses a role\-specialized multi\-agent process to progressively translate these high\-level synthesis decisions into environment\-grounded and verified experience\.

##### Designer: Strategic Synthesis Planning\.

The Designer Agent operates over the synthesis space rather than individual examples\. Given𝒪r\\mathcal\{O\}\_\{r\}andαr\\alpha\_\{r\}, it constructs a generation plan

𝒢r=\{\(zi,bi\)\}i=1K=Designer⁡\(𝒪r,αr\),\\mathcal\{G\}\_\{r\}=\\left\\\{\(z\_\{i\},b\_\{i\}\)\\right\\\}\_\{i=1\}^\{K\}=\\operatorname\{Designer\}\\left\(\\mathcal\{O\}\_\{r\},\\alpha\_\{r\}\\right\),\(8\)wherezi∈𝒵⁡\(𝒪r\)z\_\{i\}\\in\\mathcal\{Z\}\(\\mathcal\{O\}\_\{r\}\)denotes a synthesis direction andbib\_\{i\}its allocated budget\. The Designer thus operationalizes the revised state into decisions about*what regions to target*and*how much experience to generate*, separating round\-level synthesis planning from the Reflector’s meta\-level revision\.

##### Planner: Grounding Synthesis Intent\.

A synthesis direction specifies desired interaction properties but is not itself an executable task\. The Planner Agent bridges this abstraction gap by producing an environment\-grounded blueprint

qi=Planner⁡\(zi,𝒪r,ℰ\),q\_\{i\}=\\operatorname\{Planner\}\\left\(z\_\{i\},\\mathcal\{O\}\_\{r\},\\mathcal\{E\}\\right\),\(9\)which specifies the user goal, required environment conditions, relevant policy constraints, expected tool interactions, and target outcome\. The Planner therefore serves as a grounding layer between synthesis\-level intent and environment\-level task realization\.

##### Executable Realization and Verification\.

Givenqiq\_\{i\}, the Generator Agent instantiates a concrete taskxi=Generator⁡\(qi,ℰ\)x\_\{i\}=\\operatorname\{Generator\}\(q\_\{i\},\\mathcal\{E\}\), and a rollout teacher interacts with the environment to produce a candidate successful trajectoryτi=RolloutTeacher⁡\(xi,ℰ\)\\tau\_\{i\}=\\operatorname\{RolloutTeacher\}\(x\_\{i\},\\mathcal\{E\}\)\. A Verifier Agent then checks executability, tool\-call validity, policy compliance, state consistency, and task success, retaining only valid task–trajectory pairs:

𝒟r=\{\(xi,τi\)∣Verifier⁡\(xi,τi,ℰ\)=1\}\.\\mathcal\{D\}\_\{r\}=\\left\\\{\(x\_\{i\},\\tau\_\{i\}\)\\mid\\operatorname\{Verifier\}\(x\_\{i\},\\tau\_\{i\},\\mathcal\{E\}\)=1\\right\\\}\.\(10\)
This role specialization forms a coarse\-to\-fine synthesis process: the Designer performs strategic allocation over the controllable space, the Planner grounds abstract targets into feasible task structures, and the Generator, rollout teacher, and Verifier realize and validate executable experience\.

### 4\.4Task\-Agent Learning and Closing the Loop

The verified task–trajectory pairs𝒟r\\mathcal\{D\}\_\{r\}are converted into supervision for the downstream task agent while preserving user messages, tool calls, environment observations, and target responses\. To incorporate newly synthesized experience without discarding previously covered interactions,EvoSyntrains on accumulated verified data𝒯≤r=⋃t=1r𝒯t\\mathcal\{T\}\_\{\\leq r\}=\\bigcup\_\{t=1\}^\{r\}\\mathcal\{T\}\_\{t\}using supervised fine\-tuning:

θr\+1=argminθ∑\(s,a\)∈𝒯≤r−logπθ\(a∣s\),\\theta\_\{r\+1\}=\\arg\\min\_\{\\theta\}\\sum\_\{\(s,a\)\\in\\mathcal\{T\}\_\{\\leq r\}\}\-\\log\\pi\_\{\\theta\}\(a\\mid s\),\(11\)wheressdenotes the interaction context andaathe target response or tool action\.

The updated task agentπθr\+1\\pi\_\{\\theta\_\{r\+1\}\}is then evaluated on a held\-out diagnostic set in the target environment\. Its performance, together with synthesis coverage and failure diagnostics, forms the feedbackFrF\_\{r\}described in Section[4\.2](https://arxiv.org/html/2610.12593#S4.SS2), which the Reflector uses to revise the next synthesis stateSr\+1=\(𝒪r\+1,αr\+1\)S\_\{r\+1\}=\(\\mathcal\{O\}\_\{r\+1\},\\alpha\_\{r\+1\}\)\. The resulting closed loop isSr→𝒟r→πθr\+1→Fr→Sr\+1\.S\_\{r\}\\rightarrow\\mathcal\{D\}\_\{r\}\\rightarrow\\pi\_\{\\theta\_\{r\+1\}\}\\rightarrow F\_\{r\}\\rightarrow S\_\{r\+1\}\.Thus, each round updates the learner through synthesized experience while using the learner’s resulting behavior to reshape future synthesis, enabling the task agent and synthesis process to co\-evolve over rounds\.

Table 1:Overall task success rate \(%\) on agentic benchmarks\. For a consistent comparison across synthesis approaches, all synthesis methods use Qwen3\-8B as the downstream task agent\.EvoSyn\-R1 uses first\-round data, whileEvoSyn\-Final\-SFT uses accumulated multi\-round data\.MethodSynthesis LLMτ2\\tau^\{2\}\-BenchCAR\-BenchAvg\.AirlineRetailTelecom*Frontier Closed\-source Models*Claude Opus 4\.5–79\.391\.888\.082\.085\.3GPT\-5\.2–83\.081\.689\.774\.082\.1Gemini\-3 Pro–80\.575\.991\.067\.378\.7*Open\-Source Foundation Models*Qwen3\-8B–37\.340\.140\.340\.039\.4Qwen3\-30B–62\.075\.441\.849\.357\.1Qwen3\-235B–64\.783\.365\.865\.369\.8*General Agentic Synthesis Baselines*AgentSkillsGPT\-5\.235\.364\.361\.451\.353\.0EnvScalerGPT\-4\.136\.058\.238\.648\.745\.3KlearAgentForgeStrong LLMs40\.769\.336\.346\.748\.2AgenticQwenQwen3\-235B45\.365\.547\.156\.053\.4*Synthesis Variant Baselines*Monolithic SynthesisOpus 4\.547\.353\.556\.440\.649\.5Fixed\-State SynthesisOpus 4\.554\.759\.161\.748\.756\.1R\-Zero StyleOpus 4\.559\.369\.667\.356\.763\.2AutoPlay StyleOpus 4\.560\.771\.370\.855\.364\.5*Ours*EvoSyn\-R1Qwen3\-30B62\.071\.443\.847\.356\.1EvoSyn\-Final\-SFTQwen3\-30B68\.276\.347\.752\.761\.2EvoSyn\-R1Qwen3\-235B65\.380\.163\.558\.666\.9EvoSyn\-Final\-SFTQwen3\-235B70\.684\.268\.463\.371\.6EvoSyn\-R1Opus 4\.564\.878\.379\.860\.770\.9EvoSyn\-Final\-SFTOpus 4\.571\.383\.683\.972\.677\.8

## 5Experiments

### 5\.1Experimental Setup

Datasets and metrics\.We evaluateEvoSynonτ2\\tau^\{2\}\-Bench and CAR\-Bench, both of which provide executable environments and automatic task\-level evaluators\. Across all benchmarks, we report task success rate under the corresponding environment evaluator\.LLM backbones\.We include closed\-source models Claude Haiku 4\.5, Claude Sonnet 4\.5, Claude Opus 4\.5, GPT\-5\.2, Gemini\-3 Flash and Gemini\-3 Pro, and open\-source Qwen3 models including 8B, 14B and 30B\. Qwen3\-8B is the default task\-agent backbone, Qwen3\-14B and Qwen3\-30B are used for task\-agent scaling\. Qwen3\-30B, Qwen3\-235B and Claude Opus 4\.5 are used as synthesis LLMs\.Experimental protocol\.Full experimental details, hyperparameters and settings are provided in Appendix[B\.1](https://arxiv.org/html/2610.12593#A2.SS1)\.

### 5\.2RQ1: Overall Effectiveness

Table[1](https://arxiv.org/html/2610.12593#S4.T1)shows thatEvoSynconsistently outperforms multiple classes of competing approaches across all evaluated environments\. With Opus 4\.5 as the synthesis LLM,EvoSyn\-Final\-SFT achieves an average success rate of 77\.8%, substantially exceeding all general agentic synthesis baselines as well as the stronger synthesis variants, including Monolithic, Fixed\-State, R\-Zero\-style, and AutoPlay\-style synthesis\. It also outperforms all directly evaluated open\-source foundation models despite training only a Qwen3\-8B task agent, highlighting the value of targeted synthetic experience beyond model scale alone\. The advantage is already visible after the first synthesis round, whereEvoSyn\-R1 reaches 70\.9%, while feedback\-guided multi\-round evolution further improves performance to 77\.8%, demonstrating additional gains from continually revising what experience the learner receives\. Importantly, the same trend holds with both Qwen3\-30B and Qwen3\-235B synthesis backends, indicating that the framework is not tied to a particular frontier generator\. Moreover, Appendix[B\.2](https://arxiv.org/html/2610.12593#A2.SS2)Table[4](https://arxiv.org/html/2610.12593#A2.T4)shows that the benefit persists as the downstream learner scales:EvoSyn\-Final\-SFT reaches 80\.9% with Qwen3\-14B and 86\.0% with Qwen3\-30B task agents\.

### 5\.3RQ2: Ablation Study

Table[2](https://arxiv.org/html/2610.12593#S5.T2)shows that the fullEvoSynachieves the strongest downstream performance and intrinsic data quality across both Airline and CAR\-Bench, consistently leading all reported metrics\. Removing learning feedback reduces success from 0\.713 to 0\.660 on Airline and from 0\.726 to 0\.613 on CAR\-Bench, while trajectory diversity also drops markedly, indicating that feedback reshapes the structural support of synthesized experience rather than merely filtering individual samples\. Removing the Reflector consistently degrades both task performance and data quality, with CAR\-Bench factor coverage falling from 0\.893 to 0\.803 and trajectory diversity from 0\.938 to 0\.800\. This supports the role of synthesis\-space expansion: recurrent learner failures reveal useful interaction factors that cannot be recovered by allocation over the existing space alone\. Removing the Designer exposes a complementary failure mode, reducing CAR\-Bench success to 0\.540 and factor coverage to 0\.634, showing that discovering useful factors is insufficient unless synthesis effort is actively redirected toward them\. The accompanying degradation in balance, interaction coverage, and trajectory diversity further suggests that allocation affects not only which regions are emphasized, but also the overall composition of the resulting training experience\. Finally, Single\-Agent Synthesis performs worst overall, with Airline trajectory diversity collapsing from 0\.769 to 0\.077 and CAR\-Bench success falling to 0\.406, demonstrating that role specialization is critical for producing broad, diverse, and effective agentic supervision\.

Table 2:Ablation study onτ2\\tau^\{2\}\-Bench Airline and CAR\-Bench Base\. All variants use Opus 4\.5 as the synthesis LLM, Qwen3\-8B as the task agent, Final\-SFT as the training protocol, and the same candidate generation budget\. Intrinsic data\-quality metrics are computed only on the final verified synthetic samples and normalized to\[0,1\]\[0,1\], where higher is better\.Methodτ2\\tau^\{2\}\-Bench AirlineCAR\-Bench BaseSuccessRateFactorCoverageFactorBalanceInteractionCoverageTrajectoryDiversitySuccessRateFactorCoverageFactorBalanceInteractionCoverageTrajectoryDiversityEvoSyn0\.7130\.8910\.4500\.4550\.7690\.7260\.8930\.5080\.3730\.938w/o Learning Feedback0\.6600\.7780\.3680\.4030\.5380\.6130\.7870\.4680\.3510\.750w/o Reflector0\.6730\.8620\.4130\.4370\.6150\.6330\.8030\.4830\.3500\.800w/o Designer0\.6130\.7660\.3870\.4120\.4620\.5400\.6340\.4500\.3390\.733Single\-Agent Synthesis0\.5470\.3650\.1650\.1330\.0770\.4060\.4650\.4250\.2870\.467

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/car_case_2.png)Figure 3:Closed\-loop synthesis\-space evolution on CAR\-Bench\. As learner weaknesses shift across rounds,EvoSynpromotes newly discovered interaction factors into explicit generation controls and redirects synthesis toward the evolving capability boundary, progressing from write\-intensive execution to increasingly read\-intensive decision making\.
### 5\.4RQ3: How Does Learner Feedback Evolve the Synthesis Space?

Figure[3](https://arxiv.org/html/2610.12593#S5.F3)illustrates howEvoSynrevises its synthesis focus as the learner’s capability boundary changes\. After R1, failures concentrate on execution\-heavy tasks with many state\-changing actions, prompting the Reflector to introducenum\_writeand the Designer to shift R2 toward high\-write trajectories\. After R2, the residual weakness moves to read\-heavy tasks, leading to the introduction ofnum\_readand a corresponding R3 shift toward read–decide–act interactions\. Two controls further support this mechanism\. The feedback\-conditioned Reflector recovers both subsequently adopted factors \(2/22/2\), whereas a no\-feedback control proposes six plausible dimensions but recovers neither \(0/60/6; Appendix[B\.6](https://arxiv.org/html/2610.12593#A2.SS6), Table[6](https://arxiv.org/html/2610.12593#A2.T6)\)\. The promoted coordinates are also operational generation controls: requested and realized factor values agree with99\.699\.6–100%100\\%exact accuracy and Spearmanρ=0\.997\\rho=0\.997–1\.0001\.000across R2 synthesis runs \(Appendix[B\.7](https://arxiv.org/html/2610.12593#A2.SS7), Table[7](https://arxiv.org/html/2610.12593#A2.T7)\)\. These results indicate thatEvoSynperforms a learner\-grounded synthesis\-space revision rather than a generic expansion\.

Figure[4](https://arxiv.org/html/2610.12593#S5.F4)further shows that this evolution yields more useful experience than simply accumulating static samples\. Starting from the same R1 data, Static Multi\-Round changes from 0\.607 to 0\.627 and then 0\.613, whereasEvoSynimproves monotonically from 0\.607 to 0\.655 and 0\.726\. Its final data also achieves higher factor coverage \(0\.893 vs\. 0\.787\) and trajectory\-pattern diversity \(0\.938 vs\. 0\.750\)\. Thus, later rounds are beneficial not merely because they add data, but because feedback changes both what can be synthesized and where synthesis effort is allocated\. Detailed CAR\-Bench evidence is provided in Appendix[B\.13\.1](https://arxiv.org/html/2610.12593#A2.SS13.SSS1), with aτ2\\tau^\{2\}\-Bench case in Appendix[B\.13\.2](https://arxiv.org/html/2610.12593#A2.SS13.SSS2)\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/rq3_car_intrinsic_quality.png)Figure 4:Closed\-loop evolution of task performance and synthetic\-data quality on CAR\-Bench\. Unlike static accumulation,EvoSynprogressively improves both downstream success and the structural quality of synthesized experience across successive synthesis rounds\.
### 5\.5RQ4:EvoSynAdapts Synthesis Toward Capability Gaps

We further examine whether the closed loop inEvoSynproduces targeted capability evolution, rather than merely changing the data distribution or improving average performance\. Figure[5](https://arxiv.org/html/2610.12593#S5.F5)illustrates the R1→\\rightarrowR2 transition on CAR\-Bench Base by aligning the task agent’s pre\-round capability gap, the next round’s verified\-data proportion shift, and the post\-round capability gain over the same interaction slices\. The resulting pattern reveals a two\-stage self\-correcting process\. After R1, the largest actionable weakness lies in write\-heavy execution;EvoSyncorrespondingly shifts R2 synthesis toward multi\-write and high\-write tasks, and these targeted slices improve after training\. After R2, the residual weakness moves from execution\-heavy writing to read\-heavy decision making;EvoSynredirects R3 synthesis toward multi\-read, navigation, and read\-then\-set interactions, which also improve in the next evaluation\. The corresponding R2→\\rightarrowR3 transition and detailed statistics are provided in Appendix[B\.5](https://arxiv.org/html/2610.12593#A2.SS5), showing that the system reallocates synthesis toward the current capability boundary and pivots as that boundary evolves\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/rq4_car_capability_evolution_v2_r1_r2.png)Figure 5:Capability\-gap\-driven synthesis adaptation on CAR\-Bench\. The three panels trace the closed\-loop transition from pre\-round capability gaps to next\-round synthesis reallocation and subsequent capability changes, showing howEvoSynredirects synthesis toward learner weaknesses\.
### 5\.6RQ5: How DoesEvoSynDiffer from Existing Synthetic Corpora?

We further compareEvoSynwith publicly released synthetic corpora constructed for the same environment\. As shown in Figure[7](https://arxiv.org/html/2610.12593#A2.F7), under matched data budgets on Airline,EvoSynprovides the largest unique decisive interaction support \(73\.0%73\.0\\%\), compared with AReaL\-SEA \(69\.0%69\.0\\%\), APIGen\-MT \(49\.8%49\.8\\%\), and WRIT \(25\.5%25\.5\\%\)\. This complementarity also grows through synthesis\-space evolution, with baseline\-unseen structural support increasing from13\.6%13\.6\\%in R1 to79\.4%79\.4\\%in later rounds\. Appendix[B\.4](https://arxiv.org/html/2610.12593#A2.SS4)further shows substantially higher order\-sensitive contrastive support and more balanced synthesis across interaction structures\. These results show that feedback\-guided evolution changes both the support and distribution of synthesized experience, rather than merely generating additional variants within a fixed synthesis space, as learner weaknesses evolve through later rounds\.

## 6Conclusion

In this paper, we presentEvoSyn, a closed\-loop multi\-agent framework for self\-evolving agentic data synthesis\. By coupling environment\-grounded generation with task\-agent learning,EvoSynuses post\-training feedback to both reallocate synthesis effort within known interaction factors and expand the synthesis space with newly discovered factors\. Experiments onτ2\\tau^\{2\}\-Bench and CAR\-Bench show consistent improvements in task\-agent performance and synthetic\-data quality, while demonstrating that learner feedback reveals useful interaction factors missed by feedback\-free synthesis\. Further analyses show that this iterative evolution progressively broadens the structural support of synthesized experience beyond that covered by existing synthesis pipelines\.

## References

- Cao et al\. \(2025\)Maosong Cao, Taolin Zhang, Mo Li, Chuyu Zhang, Yunxin Liu, Haodong Duan, Songyang Zhang, and Kai Chen\.Condor: Enhance llm alignment with knowledge\-driven data synthesis and refinement\.*arXiv preprint arXiv:2501\.12273*, 2\(4\), 2025\.
- Chen et al\. \(2026\)Jiaao Chen, Jingyuan Qi, Mingye Gao, Wei\-Chen Wang, Hanrui Wang, and Di Jin\.Eigendata: A self\-evolving multi\-agent platform for function\-calling data synthesis, auditing, and repair\.*arXiv preprint arXiv:2603\.05553*, 2026\.
- Chen et al\. \(2025\)Zhaorun Chen, Zhuokai Zhao, Kai Zhang, Bo Liu, Qi Qi, Yifan Wu, Tarun Kalluri, Sara Cao, Yuanhao Xiong, Haibo Tong, et al\.Scaling agent learning via experience synthesis\.*arXiv preprint arXiv:2511\.03773*, 2025\.
- Cheng et al\. \(2025\)Yuhao Cheng, Liang Tang, Shuxian Li, Yukang Huo, Tiaonan Duan, Kaer Huang, Yanzhe Jing, and Yiqiang Yan\.Evolving in tasks: Empowering the multi\-modality large language model as the computer use agent\.*arXiv preprint arXiv:2508\.04037*, 2025\.
- Dai et al\. \(2026\)Yuqin Dai, Ning Gao, Wei Zhang, Jie Wang, Zichen Luo, Jinpeng Wang, Yujie Wang, Ruiyuan Wu, and Chaozheng Wang\.Sead: Self\-evolving agent for multi\-turn service dialogue\.*arXiv preprint arXiv:2602\.03548*, 2026\.
- Dong et al\. \(2026\)Guanting Dong, Junting Lu, Junjie Huang, Wanjun Zhong, Longxiang Liu, Shijue Huang, Zhenyu Li, Yang Zhao, Xiaoshuai Song, Xiaoxi Li, et al\.Agent\-world: Scaling real\-world environment synthesis for evolving general agent intelligence\.*arXiv preprint arXiv:2604\.18292*, 2026\.
- Gao et al\. \(2026\)Jiaxuan Gao, Jiaao Chen, Chuyi He, Wei\-Chen Wang, Shusheng Xu, Hanrui Wang, Di Jin, and Yi Wu\.From self\-evolving synthetic data to verifiable\-reward rl: Post\-training multi\-turn interactive tool\-using agents\.*arXiv preprint arXiv:2601\.22607*, 2026\.
- Gou et al\. \(2024\)Zhibin Gou, Zhihong Shao, Yeyun Gong, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen, et al\.Tora: A tool\-integrated reasoning agent for mathematical problem solving\.In*International Conference on Learning Representations*, volume 2024, pp\. 48362–48395, 2024\.
- Gu et al\. \(2026\)Hengrui Gu, Xiaotian Han, and Kaixiong Zhou\.Writ: Write\-read intensive trajectory synthesis for multi\-turn user\-facing agents\.*arXiv preprint arXiv:2606\.02908*, 2026\.
- He et al\. \(2025\)Junliang He, Ziyue Fan, Shaohui Kuang, Li Xiaoqing, Kai Song, Yaqian Zhou, and Xipeng Qiu\.Fine: Filtering and improving noisy data elaborately with large language models\.In*Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\)*, pp\. 8686–8707, 2025\.
- Huang et al\. \(2025\)Chengsong Huang, Wenhao Yu, Xiaoyang Wang, Hongming Zhang, Zongxia Li, Ruosen Li, Jiaxin Huang, Haitao Mi, and Dong Yu\.R\-zero: Self\-evolving reasoning llm from zero data\.*arXiv preprint arXiv:2508\.05004*, 2025\.
- Kwan et al\. \(2026\)Wai\-Chung Kwan, Aryo Pradipta Gema, Joshua Ong Jun Leang, and Pasquale Minervini\.Scope: Self\-play via co\-evolving policies for open\-ended tasks\.*arXiv preprint arXiv:2605\.31433*, 2026\.
- Li et al\. \(2024\)Jia Li, Edward Beeching, Lewis Tunstall, Ben Lipkin, Roman Soletskyi, Shengyi Huang, Kashif Rasul, Longhui Yu, Albert Q Jiang, Ziju Shen, et al\.Numinamath: The largest public dataset in ai4maths with 860k pairs of competition math problems and solutions\.*Hugging Face repository*, 13\(9\):9, 2024\.
- Li et al\. \(2023\)Xian Li, Ping Yu, Chunting Zhou, Timo Schick, Omer Levy, Luke Zettlemoyer, Jason E Weston, and Mike Lewis\.Self\-alignment with instruction backtranslation\.In*The twelfth international conference on learning representations*, 2023\.
- Li et al\. \(2026\)Zhongzhi Li, Xuansheng Wu, Yijiang Li, Lijie Hu, and Ninghao Liu\.Less is enough: synthesizing diverse data in feature space of llms\.*arXiv e\-prints*, pp\. arXiv–2602, 2026\.
- Liang et al\. \(2026\)Xiao Liang, Zhong\-Zhi Li, Yeyun Gong, Yang Wang, Hengyuan Zhang, Ying Nian Wu, Weizhu Chen, et al\.Sws: Self\-aware weakness\-driven problem synthesis in reinforcement learning for llm reasoning\.*Advances in Neural Information Processing Systems*, 38:56801–56839, 2026\.
- Luo et al\. \(2025\)Haipeng Luo, Qingfeng Sun, Can Xu, Pu Zhao, Jian\-Guang Lou, Chongyang Tao, Xiubo Geng, Qingwei Lin, Shifeng Chen, Yansong Tang, et al\.Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol\-instruct\.In*International Conference on Learning Representations*, volume 2025, pp\. 49573–49609, 2025\.
- Lyu et al\. \(2026\)Yuanjie Lyu, Chengyu Wang, Haonan Zheng, Yuanhao Yue, Junbing Yan, Ming Wang, and Jun Huang\.Agenticqwen: Training small agentic language models with dual data flywheels for industrial\-scale tool use\.In*Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(ACL 2026\)*, pp\. 535–551, 2026\.
- Pahuja et al\. \(2025\)Vardaan Pahuja, Yadong Lu, Corby Rosset, Boyu Gou, Arindam Mitra, Spencer Whitehead, Yu Su, and Ahmed Hassan\.Explorer: Scaling exploration\-driven web trajectory synthesis for multimodal web agents\.In*Findings of the Association for Computational Linguistics: ACL 2025*, pp\. 6300–6323, 2025\.
- Prabhakar et al\. \(2026\)Akshara Prabhakar, Zuxin Liu, Ming Zhu, Jianguo Zhang, Tulika Manoj Awalgaonkar, Shiyu Wang, Zhiwei Liu, Haolin Chen, Thai Hoang, Juan Carlos Niebles, et al\.Apigen\-mt: Agentic pipeline for multi\-turn data generation via simulated agent\-human interplay\.*Advances in Neural Information Processing Systems*, 38, 2026\.
- Ramrakhya et al\. \(2025\)Ram Ramrakhya, Andrew Szot, Omar Attia, Yuhao Yang, Anh Nguyen, Bogdan Mazoure, Zhe Gan, Harsh Agrawal, and Alexander Toshev\.Scaling synthetic task generation for agents via exploration\.*arXiv preprint arXiv:2509\.25047*, 2025\.
- Shao et al\. \(2024\)Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, YK Li, Yang Wu, et al\.Deepseekmath: Pushing the limits of mathematical reasoning in open language models\.*arXiv preprint arXiv:2402\.03300*, 2024\.
- Song et al\. \(2026\)Xiaoshuai Song, Haofei Chang, Guanting Dong, Yutao Zhu, Ji\-Rong Wen, and Zhicheng Dou\.Envscaler: Scaling tool\-interactive environments for llm agent via programmatic synthesis\.In*Findings of the Association for Computational Linguistics: ACL 2026*, pp\. 8326–8357, 2026\.
- Sun et al\. \(2025\)Qiushi Sun, Kanzhi Cheng, Zichen Ding, Chuanyang Jin, Yian Wang, Fangzhi Xu, Zhenyu Wu, Chengyou Jia, Liheng Chen, Zhoumianze Liu, et al\.Os\-genesis: Automating gui agent trajectory construction via reverse task synthesis\.In*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pp\. 5555–5579, 2025\.
- Sun et al\. \(2026\)Zexu Sun, Bokai Ji, Hengyi Cai, Shuaiqiang Wang, Lei Wang, Guangxia Li, and Xu Chen\.Agentskiller: Scaling generalist agent intelligence through semantically integrated cross\-domain data synthesis\.*arXiv preprint arXiv:2602\.09372*, 2026\.
- Tang et al\. \(2025\)Shuo Tang, Xianghe Pang, Zexi Liu, Bohan Tang, Rui Ye, Tian Jin, Xiaowen Dong, Yanfeng Wang, and Siheng Chen\.Synthesizing post\-training data for llms through multi\-agent simulation\.In*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pp\. 23306–23335, 2025\.
- Tu et al\. \(2025\)Zeao Tu, Xiangdi Meng, Yu He, Zihan Yao, Tianyu Qi, Jun Liu, and Ming Li\.Resofilter: Fine\-grained synthetic data filtering for large language models through data\-parameter resonance analysis\.In*Findings of the Association for Computational Linguistics: NAACL 2025*, pp\. 5414–5428, 2025\.
- Wang et al\. \(2025a\)Qi Wang, Hongzhi Zhang, Jia Fu, Kai Fu, Yahui Liu, Tinghai Zhang, Chenxi Sun, Gangwei Jiang, Jingyi Tang, Xingguang Ji, et al\.Klear\-agentforge: Forging agentic intelligence through posttraining scaling\.*arXiv preprint arXiv:2511\.05951*, 2025a\.
- Wang et al\. \(2026a\)Rui Wang, Ce Zhang, Jun\-Yu Ma, Jianshu Zhang, Hongru Wang, Yi Chen, Boyang Xue, Tianqing Fang, Zhisong Zhang, Hongming Zhang, et al\.Webaggregator: Enhancing compositional reasoning capabilities of deep research agent foundation models\.In*Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pp\. 24486–24517, 2026a\.
- Wang et al\. \(2025b\)Shaobo Wang, Zhengbo Jiao, Zifan Zhang, Yilang Peng, Xu Ze, Boyu Yang, Wei Wang, Hu Wei, and Linfeng Zhang\.Socratic\-zero: Bootstrapping reasoning via data\-free agent co\-evolution\.*arXiv preprint arXiv:2509\.24726*, 2025b\.
- Wang et al\. \(2023\)Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu, Noah A Smith, Daniel Khashabi, and Hannaneh Hajishirzi\.Self\-instruct: Aligning language models with self\-generated instructions\.In*Proceedings of the 61st annual meeting of the association for computational linguistics \(volume 1: long papers\)*, pp\. 13484–13508, 2023\.
- Wang et al\. \(2026b\)Ziyi Wang, Yuxuan Lu, Yimeng Zhang, Pei Chen, Ziwei Dong, Jing Huang, Jiri Gesi, Xianfeng Tang, Chen Luo, Qun Liu, et al\.Trajectory2task: Training robust tool\-calling agents with synthesized yet verifiable data for complex user intents\.In*Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pp\. 44021–44044, 2026b\.
- Wu et al\. \(2025\)Rong Wu, Xiaoman Wang, Jianbiao Mei, Pinlong Cai, Daocheng Fu, Cheng Yang, Licheng Wen, Xuemeng Yang, Yufan Shen, Yuxin Wang, et al\.Evolver: Self\-evolving llm agents through an experience\-driven lifecycle\.*arXiv preprint arXiv:2510\.16079*, 2025\.
- Xia et al\. \(2025\)Peng Xia, Kaide Zeng, Jiaqi Liu, Can Qin, Fang Wu, Yiyang Zhou, Caiming Xiong, and Huaxiu Yao\.Agent0: Unleashing self\-evolving agents from zero data via tool\-integrated reasoning\.*arXiv preprint arXiv:2511\.16043*, 2025\.
- Xu et al\. \(2024\)Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, Qingwei Lin, and Daxin Jiang\.Wizardlm: Empowering large pre\-trained language models to follow complex instructions\.In*International Conference on Learning Representations*, volume 2024, pp\. 30745–30766, 2024\.
- Yang et al\. \(2025a\)Chen Yang, Ran Le, Yun Xing, Zhenwei An, Zongchao Chen, Wayne Xin Zhao, Yang Song, and Tao Zhang\.Toolmind technical report: A large\-scale, reasoning\-enhanced tool\-use dataset\.*arXiv preprint arXiv:2511\.15718*, 2025a\.
- Yang et al\. \(2026\)Shidong Yang, Ziyu Ma, Tongwen Huang, Yiming Hu, Yong Wang, and Xiangxiang Chu\.Coevolve: Training llm agents via agent\-data mutual evolution\.In*Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, pp\. 23015–23036, 2026\.
- Yang et al\. \(2025b\)Wei Yang, Muyan Weng, Jiacheng Pang, Defu Cao, Heng Ping, Peiyu Zhang, Shixuan Li, Yue Zhao, Qiang Yang, Mengdi Wang, et al\.Toward evolutionary intelligence: Llm\-based agentic systems with multi\-agent reinforcement learning\.*Available at SSRN 5819182*, 2025b\.
- Yu et al\. \(2023\)Longhui Yu, Weisen Jiang, Han Shi, Jincheng Yu, Zhengying Liu, Yu Zhang, James T Kwok, Zhenguo Li, Adrian Weller, and Weiyang Liu\.Metamath: Bootstrap your own mathematical questions for large language models\.*arXiv preprint arXiv:2309\.12284*, 2023\.
- Yue et al\. \(2024\)Xiang Yue, Xingwei Qu, Ge Zhang, Yao Fu, Wenhao Huang, Huan Sun, Yu Su, and Wenhu Chen\.Mammoth: Building math generalist models through hybrid instruction tuning\.In*International Conference on Learning Representations*, volume 2024, pp\. 40320–40341, 2024\.
- Yue et al\. \(2026\)Zhenrui Yue, Kartikeya Upasani, Xianjun Yang, Suyu Ge, Shaoliang Nie, Yuning Mao, Zhe Liu, and Dong Wang\.Dr\. zero: Self\-evolving search agents without training data\.*arXiv preprint arXiv:2601\.07055*, 2026\.
- Zelikman et al\. \(2022\)Eric Zelikman, Yuhuai Wu, Jesse Mu, and Noah Goodman\.Star: Bootstrapping reasoning with reasoning\.*Advances in Neural Information Processing Systems*, 35:15476–15488, 2022\.
- Zhai et al\. \(2025\)Yunpeng Zhai, Shuchang Tao, Cheng Chen, Anni Zou, Ziqian Chen, Qingxu Fu, Shinji Mai, Li Yu, Jiaji Deng, Zouying Cao, et al\.Agentevolver: Towards efficient self\-evolving agent system\.*arXiv preprint arXiv:2511\.10395*, 2025\.
- Zhang et al\. \(2026\)Shuo Zhang, Chaofa Yuan, Ryan Guo, Xiaomin Yu, Rui Xu, Zhangquan Chen, Zinuo Li, Zhi Yang, Shuhao Guan, Zhenheng Tang, et al\.Evofsm: Controllable self\-evolution for deep research with finite state machines\.*arXiv preprint arXiv:2601\.09465*, 2026\.

## Appendix

## Appendix AMethod

### A\.1Problem Formulation

##### Interactive Agentic Synthesis\.

We consider synthetic data generation for improving language\-model agents in interactive tool\-use environments\. Letℰ\\mathcal\{E\}denote an environment that specifies domain policies, tool interfaces, state constraints, and an automatic task evaluator, and letπθr\\pi\_\{\\theta\_\{r\}\}denote the task agent at synthesis roundrr\. A synthesized training example consists of a taskxxand an interaction trajectoryτ\\tau, whereτ\\taucontains the sequence of language responses, tool calls, and environment observations produced while solvingxx\. We denote by

Vℰ​\(x,τ\)∈\{0,1\}V\_\{\\mathcal\{E\}\}\(x,\\tau\)\\in\\\{0,1\\\}the environment verifier, which determines whether the task–trajectory pair is executable, policy\-consistent, state\-consistent, and successful under the environment evaluator\.

At roundrr, a synthesis process generates a candidate set𝒟~r=\{\(xi,τi\)\}i=1Nr\\widetilde\{\\mathcal\{D\}\}\_\{r\}=\\\{\(x\_\{i\},\\tau\_\{i\}\)\\\}\_\{i=1\}^\{N\_\{r\}\}, from which verified supervision is retained as

𝒟r=\{\(xi,τi\)∈𝒟~r∣Vℰ​\(xi,τi\)=1\}\.\\mathcal\{D\}\_\{r\}=\\left\\\{\(x\_\{i\},\\tau\_\{i\}\)\\in\\widetilde\{\\mathcal\{D\}\}\_\{r\}\\mid V\_\{\\mathcal\{E\}\}\(x\_\{i\},\\tau\_\{i\}\)=1\\right\\\}\.\(12\)The task agent is trained on accumulated verified experience,

πθr\+1=Train⁡\(πθr,𝒟≤r\),𝒟≤r=⋃t=1r𝒟t\.\\pi\_\{\\theta\_\{r\+1\}\}=\\operatorname\{Train\}\\left\(\\pi\_\{\\theta\_\{r\}\},\\mathcal\{D\}\_\{\\leq r\}\\right\),\\qquad\\mathcal\{D\}\_\{\\leq r\}=\\bigcup\_\{t=1\}^\{r\}\\mathcal\{D\}\_\{t\}\.\(13\)We measure the resulting agent by its held\-out task successJ⁡\(πθr\+1\)J\(\\pi\_\{\\theta\_\{r\+1\}\}\)in the target environment\. Unlike one\-pass synthesis, however, the value of newly synthesized data depends on the current learner: an example can be fully valid while providing little useful experience for an agent that has already mastered the corresponding interaction pattern\.

##### Revisable Synthesis State\.

To make this learner dependence explicit, we characterize synthesis at roundrrby a state

Sr=\(𝒪r,αr\),S\_\{r\}=\\left\(\\mathcal\{O\}\_\{r\},\\alpha\_\{r\}\\right\),\(14\)which separates two complementary decisions\. The*synthesis space*𝒪r\\mathcal\{O\}\_\{r\}specifies*what interaction properties can be deliberately synthesized*, whileαr\\alpha\_\{r\}specifies*where synthesis effort is allocated within that space*\. We use𝒵⁡\(𝒪r\)\\mathcal\{Z\}\(\\mathcal\{O\}\_\{r\}\)to denote the set of synthesis directions expressible under𝒪r\\mathcal\{O\}\_\{r\}\. A directionz∈𝒵⁡\(𝒪r\)z\\in\\mathcal\{Z\}\(\\mathcal\{O\}\_\{r\}\)corresponds to a controllable region of the synthesis space, whose concrete structure is introduced in Section[4](https://arxiv.org/html/2610.12593#S4)\.

Given a synthesis budgetBrB\_\{r\}, we view

αr:𝒵⁡\(𝒪r\)→ℝ≥0,∑z∈𝒵⁡\(𝒪r\)αr​\(z\)=Br,\\alpha\_\{r\}:\\mathcal\{Z\}\(\\mathcal\{O\}\_\{r\}\)\\rightarrow\\mathbb\{R\}\_\{\\geq 0\},\\qquad\\sum\_\{z\\in\\mathcal\{Z\}\(\\mathcal\{O\}\_\{r\}\)\}\\alpha\_\{r\}\(z\)=B\_\{r\},\(15\)as an allocation of generation effort across synthesis directions\. The synthesis process can therefore be written abstractly as

𝒟~r∼𝒢⁡\(ℰ,𝒪r,αr\),\\widetilde\{\\mathcal\{D\}\}\_\{r\}\\sim\\mathcal\{G\}\\left\(\\mathcal\{E\},\\mathcal\{O\}\_\{r\},\\alpha\_\{r\}\\right\),where𝒢\\mathcal\{G\}realizes high\-level synthesis decisions as concrete agentic tasks and trajectories\. This decomposition distinguishes changing the distribution of experience within a known space from changing the space of experience that can be deliberately generated in the first place\.

##### Feedback\-to\-Decision Revision\.

After training, the updated task agent is evaluated to obtain learner feedback

Fr=Feedback⁡\(πθr\+1,𝒟≤r,𝒪r,ℰ\),F\_\{r\}=\\operatorname\{Feedback\}\\left\(\\pi\_\{\\theta\_\{r\+1\}\},\\mathcal\{D\}\_\{\\leq r\},\\mathcal\{O\}\_\{r\},\\mathcal\{E\}\\right\),\(16\)which summarizes evidence about the learner’s current capabilities and the synthesized experience it has received\. The central problem is not merely to observeFrF\_\{r\}, but to translate it into an actionable revision of future synthesis\. We formalize this step through a synthesis revision operator

Sr\+1=Ψ⁡\(Sr,Fr\),\(𝒪r\+1,αr\+1\)=Ψ⁡\(𝒪r,αr,Fr\)\.S\_\{r\+1\}=\\Psi\(S\_\{r\},F\_\{r\}\),\\qquad\(\\mathcal\{O\}\_\{r\+1\},\\alpha\_\{r\+1\}\)=\\Psi\(\\mathcal\{O\}\_\{r\},\\alpha\_\{r\},F\_\{r\}\)\.\(17\)This revision map captures thefeedback\-to\-decision gap: learner feedback is expressed through observed behavior, whereas future synthesis requires decisions over controllable experience\.

Importantly, feedback can imply two fundamentally different forms of revision\. First, when a remaining weakness is already expressible by the current synthesis coordinates, the mismatch is*distributional*\. The synthesis space remains fixed while generation effort is redistributed:

𝒪r\+1=𝒪r⏟same synthesis space,αr\+1≠αr⏟revised allocation\.\\underbrace\{\\mathcal\{O\}\_\{r\+1\}=\\mathcal\{O\}\_\{r\}\}\_\{\\text\{same synthesis space\}\},\\qquad\\underbrace\{\\alpha\_\{r\+1\}\\neq\\alpha\_\{r\}\}\_\{\\text\{revised allocation\}\}\.\(18\)We refer to this case aswithin\-space adaptation\. It captures settings in which the appropriate interaction factor is already controllable, but the learner has received insufficient, imbalanced, or poorly targeted experience along that factor\.

Second, learner feedback may expose a systematic weakness that cannot be adequately represented by any existing synthesis coordinate\. In this case, reallocatingαr\\alpha\_\{r\}within the current space cannot directly target the underlying capability gap\. The synthesis representation itself must be revised:

𝒪r\+1=𝒪r∪Δ​𝒪r,Δ​𝒪r≠∅,\\mathcal\{O\}\_\{r\+1\}=\\mathcal\{O\}\_\{r\}\\cup\\Delta\\mathcal\{O\}\_\{r\},\\qquad\\Delta\\mathcal\{O\}\_\{r\}\\neq\\varnothing,\(19\)whereΔ​𝒪r\\Delta\\mathcal\{O\}\_\{r\}contains newly introduced controllable interaction factors\. We refer to this case assynthesis\-space expansion\. The allocationαr\+1\\alpha\_\{r\+1\}is then defined over the expanded set of synthesis directions𝒵⁡\(𝒪r\+1\)\\mathcal\{Z\}\(\\mathcal\{O\}\_\{r\+1\}\)\. Conventional adaptation over a fixed synthesis space is a special case in which𝒪r\+1=𝒪r\\mathcal\{O\}\_\{r\+1\}=\\mathcal\{O\}\_\{r\}for all rounds\.

##### Closed\-Loop Objective\.

The overall synthesis–learning process can be summarized as

Sr→synthesize𝒟r→trainπθr\+1→evaluateFr→reviseSr\+1\.S\_\{r\}\\xrightarrow\{\\;\\text\{synthesize\}\\;\}\\mathcal\{D\}\_\{r\}\\xrightarrow\{\\;\\text\{train\}\\;\}\\pi\_\{\\theta\_\{r\+1\}\}\\xrightarrow\{\\;\\text\{evaluate\}\\;\}F\_\{r\}\\xrightarrow\{\\;\\text\{revise\}\\;\}S\_\{r\+1\}\.\(20\)Given a total synthesis budgetBB, our goal is to construct a sequence of feedback\-conditioned synthesis states that maximizes the final task\-agent performance,

maxS1:RJ\(πθR\+1\)s\.t\.∑r=1RBr≤B,Sr\+1=Ψ\(Sr,Fr\)\.\\max\_\{S\_\{1:R\}\}\\quad J\\\!\\left\(\\pi\_\{\\theta\_\{R\+1\}\}\\right\)\\qquad\\text\{s\.t\.\}\\qquad\\sum\_\{r=1\}^\{R\}B\_\{r\}\\leq B,\\quad S\_\{r\+1\}=\\Psi\(S\_\{r\},F\_\{r\}\)\.\(21\)The resulting problem therefore requires deciding, at each round, whether learner feedback should change*where*synthesis effort is placed within the current space or*what*the synthesis process is capable of explicitly controlling\. Section[4](https://arxiv.org/html/2610.12593#S4)introducesEvoSyn, which instantiates this revision\-and\-realization process through a role\-specialized multi\-agent architecture\.

### A\.2Comparison with Existing Data Synthesis Frameworks

Table[3](https://arxiv.org/html/2610.12593#A1.T3)reveals a clear progression in existing data\-synthesis frameworks, but also a persistent separation between environment grounding, learner adaptation, and synthesis\-space evolution\. Reasoning\-oriented methods such as R\-Zero, Socratic\-Zero, and SwS make generation learner\-aware by targeting solver failures or capability boundaries, yet operate outside executable, stateful agent environments\. Agentic synthesis methods such as AReaL\-SEA, Explorer, AutoPlay, WebAggregator, AgentSkiller, and EnvScaler address the complementary problem: they generate executable and verifiable interaction experience, but synthesis is largely driven by environment structure, coverage, or data quality rather than by the trained learner’s post\-training response\. More tightly coupled systems, including Agent\-World, DreamGym, SEAD, Agent0, and AgenticQwen, further incorporate task\-agent feedback and closed\-loop resynthesis\. However, their adaptation remains confined to already available task representations, predefined dimensions, or free\-form generation, without explicitly revising the synthesis space when the learner exposes a previously unrepresented capability gap\.

EvoSyncloses this gap by making the synthesis representation itself part of the learning loop\. Under the conservative criteria in Table[3](https://arxiv.org/html/2610.12593#A1.T3), it is the only framework that jointly supports all eight capabilities, and in particular the only one that combines*learning\-effect feedback*with explicit*new\-factor discovery*\. Post\-training behavior is mapped into a structured and revisable synthesis space that serves simultaneously as a diagnostic representation and a generation\-control interface\. When a weakness is already expressible in the current space,EvoSynperforms known\-factor adaptation by reallocating synthesis effort toward weak or under\-covered regions\. When the weakness cannot be represented by existing coordinates, it instead expands the space by promoting a new reusable and controllable interaction factor\. This distinction is critical: rather than merely generating harder instances, repairing failed samples, or resampling weak categories,EvoSyncan change both*where*synthesis is concentrated and*what*the synthesis process is capable of explicitly controlling\. The resulting loop therefore connects executable data generation, task\-agent training, post\-training diagnosis, synthesis\-space revision, and targeted resynthesis within a unified closed\-loop framework\.

Table 3:Comparison of representative data\-synthesis methods for post\-training LLMs and agents\. ✓ indicates that the capability is explicitly supported and demonstrated by the method, while – indicates that it is absent or not demonstrated\. Partial or implicit support is conservatively marked as –\.MethodInteractiveSettingExecutable &VerifiableTask\-AgentFeedbackLearning\-EffectFeedbackStructuredTask SpaceKnown\-FactorAdaptationNew\-FactorDiscoveryClosed\-LoopEvolutionReasoning and instruction synthesisMATRIX / MATRIX\-Gen––––✓–––Socratic\-Zero––✓––✓–✓R\-Zero––✓––✓–✓SwS––✓–✓✓––Interactive and agentic data synthesisAReaL\-SEA / EigenData✓✓––––––SCOPE✓–✓––✓–✓Agent\-World✓✓✓–✓✓–✓WebAggregator✓✓––✓–––DreamGym✓✓✓––✓–✓Explorer✓✓––––––AutoPlay✓✓––✓–––SEAD✓✓✓–✓✓–✓Agent0✓✓✓––✓–✓AgentSkiller✓✓––✓–––EnvScaler✓✓––✓–––Klear\-AgentForge✓✓✓–––––AgenticQwen✓✓✓–✓✓–✓Ours✓✓✓✓✓✓✓✓

Criterion definitions\.Interactive Settingdenotes synthesis for multi\-turn interaction with users, tools, or stateful environments\.Executable & Verifiablerequires synthesized tasks or trajectories to be executable in an environment and automatically verifiable\.Task\-Agent Feedbackmeans that synthesis is informed by the current task agent’s behavior, performance, or failures\.Learning\-Effect Feedbackfurther evaluates how previously synthesized data changes the task agent after training and uses this learning effect to guide subsequent synthesis\.Structured Task Spacedenotes an explicit representation based on task factors, schemas, states, or an ontology\.Known\-Factor Adaptationadjusts difficulty, coverage, proportions, or generation budgets over already represented factors\.New\-Factor Discoveryrequires discovering a previously unrepresented reusable synthesis factor and incorporating it into future synthesis; generating new instances, trajectories, or environment states alone does not satisfy this criterion\.Closed\-Loop Evolutionrequires repeated synthesis, learner training, evaluation, and feedback\-driven resynthesis\.

### A\.3Closed\-Loop Role\-Specialized Synthesis

Agentic data synthesis spans multiple levels of abstraction\. The system must reason about what experience the current learner needs, allocate synthesis effort accordingly, translate abstract synthesis targets into feasible tasks under environment constraints, realize successful tool\-use trajectories, and verify that the resulting supervision is valid\. We therefore factorizeEvoSynby*decision abstraction*, assigning specialized agents to distinct roles in the synthesis–learning loop rather than forcing a single generator to jointly solve these heterogeneous decisions\.

At roundrr, task\-agent feedbackFrF\_\{r\}first enters a*backward synthesis\-revision path*\. A Reflector Agent reasons over learner performance, data coverage, and failure structure to revise the synthesis state,

Fr→ReflectorSr\+1=\(𝒪r\+1,αr\+1\),F\_\{r\}\\xrightarrow\{\\;\\textsc\{Reflector\}\\;\}S\_\{r\+1\}=\(\\mathcal\{O\}\_\{r\+1\},\\alpha\_\{r\+1\}\),\(22\)where𝒪r\+1\\mathcal\{O\}\_\{r\+1\}determines which interaction factors can be explicitly controlled andαr\+1\\alpha\_\{r\+1\}determines how synthesis effort is allocated over them\. Importantly, the Reflector revises the synthesis process itself rather than directly repairing individual failed examples\.

The revised synthesis state is then realized through a*forward grounded\-synthesis path*\. A Designer Agent operates at the strategic level, translating the synthesis state into generation directions and budgets\. A Planner Agent grounds each abstract direction into an environment\-consistent task blueprint, bridging synthesis\-level intent and executable task construction\. The Generator Agent and rollout teacher instantiate these blueprints into concrete tasks and successful interaction trajectories, while a Verifier Agent filters invalid supervision according to environment and task constraints\. The resulting verified experience is used to train and evaluate the task agent, producing new feedback that initiates the next round of synthesis revision\.

This decomposition gives the major components ofEvoSyndistinct but complementary roles\. The Reflector performs*meta\-level synthesis revision*, the Designer performs*round\-level synthesis planning*, and the Planner performs*instance\-level grounding*, while the Generator, rollout teacher, and Verifier realize and validate the resulting experience in the environment\. Together, these components form a closed loop in which learner behavior reshapes the synthesis process, and the revised synthesis process determines the experience from which the learner evolves\.

## Appendix BExperiments

This appendix provides additional experimental details and analyses supporting the main results\. We first describe the complete experimental setup, including datasets, synthesis backends, verification, task\-agent training, controlled baselines, intrinsic data\-quality metrics, initial synthesis spaces, and representative agent prompts\. We then examine the robustness and properties ofEvoSynthrough task\-agent scaling, Designer ablations, and comparative structural analyses against existing synthetic corpora\. A series of mechanism\-focused experiments further investigates capability\-gap\-driven reallocation, feedback\-dependent factor discovery, controllability of evolved synthesis factors, structural\-support expansion, residual learner weaknesses, and observed learning gains across rounds\. Finally, detailed CAR\-Bench andτ2\\tau^\{2\}\-Bench Airline case studies trace how learner feedback is converted into synthesis\-space revisions and subsequent changes in the generated experience\.

### B\.1Experimental Details

##### Datasets and Evaluation\.

We evaluateEvoSynonτ2\\tau^\{2\}\-Bench and CAR\-Bench, both of which provide executable interactive environments and automatic task\-level evaluators\. Forτ2\\tau^\{2\}\-Bench, we consider the Airline, Retail, and Telecom domains, while CAR\-Bench is evaluated under the Base setting\. We follow the official dataset splits and evaluate on held\-out benchmark tasks using the benchmark\-native binary task\-success reward\. Unless otherwise specified, reported results are averaged over three random seeds\.

##### Synthesis Backends\.

We instantiateEvoSynwith three synthesis backends: Claude Opus 4\.5, Qwen3\-30B\-A3B\-Thinking\-2507, and Qwen3\-235B\-A22B\-Thinking\-2507\. The open\-source Qwen3 models are served with vLLM\. Within each synthesis run, the Designer, Planner, Generator, Repair module, and Reflector share the selected backend\. Claude Opus 4\.5 is used as the user simulator during both synthesis and evaluation, with thinking disabled to match the benchmark\-standard simulator configuration\. Unless otherwise specified, the Designer, Planner, and Generator use a sampling temperature of 1\.0\. For brevity, we refer to Qwen3\-30B\-A3B\-Thinking\-2507 and Qwen3\-235B\-A22B\-Thinking\-2507 as Qwen3\-30B and Qwen3\-235B throughout the paper\.

##### Synthesis and Verification\.

Each round generates a fixed budget of synthesis blueprints within the corresponding experimental arm and retains only environment\-grounded trajectories that pass deterministic replay and achieve the benchmark reward of 1\. Main synthesis runs typically use approximately 1,200–1,500 blueprint proposals per round, with domain\-specific adjustments where necessary\. When a proposed pseudo\-ground\-truth trajectory fails replay, the Repair module is invoked for at most two attempts, with every repaired trajectory replayed from the original environment state\. The synthesis process runs for at most three rounds and terminates early after two consecutive rounds without a synthesis\-space update\. To keep synthesis\-space evolution gradual and interpretable, the Reflector introduces at most one new synthesis factor per round\. To construct learning feedback, we sample diagnostic examples from each synthesis round and accumulate them across rounds, allowing the Reflector to analyze the learner against both newly generated experience and the evolving synthesis history\.

##### Task\-Agent Training\.

Qwen3\-8B serves as the default downstream task agent, while Qwen3\-14B and Qwen3\-30B are additionally evaluated for task\-agent scaling\. We perform full\-parameter supervised fine\-tuning with LLaMA\-Factory and DeepSpeed ZeRO\-3 using the same training recipe across model scales and synthesis rounds\. We use a maximum sequence length of 16,384, six epochs, a learning rate of1×10−51\\times 10^\{\-5\}with cosine decay, a warm\-up ratio of 0\.1, BF16 precision, and FlashAttention\-2\. The per\-device batch size is 1 with two gradient\-accumulation steps over eight GPUs, yielding an effective global batch size of 16\. Training examples are exported in ShareGPT format from verified successful trajectories, and multi\-roundEvoSyntrains on the accumulated verified experience synthesized up to the corresponding round\.

##### Controlled Comparisons\.

For synthesis variants and ablations, we reuse the same environment, tool schema, domain policy, verifier, task\-agent initialization, SFT recipe, and evaluation harness, changing only the synthesis mechanism under study\. All generated trajectories are subject to the same environment replay and reward\-based verification procedure, enabling controlled comparisons of feedback, synthesis\-space evolution, and role specialization\.

##### Evaluation Protocol\.

Learner feedback used for synthesis revision is computed on a held\-out diagnostic set that is disjoint from the official test set\. The official held\-out benchmark tasks are reserved for final evaluation and reporting, using a rollout temperature of 1\.0 and the corresponding native evaluator\. Test labels are never used to drive synthesis or training\. Analyses involving newly promoted synthesis factors use the learner state before the corresponding factor is introduced, preventing post\-hoc leakage from subsequent factor\-guided synthesis or training\.

##### Baselines\.

We compare against four recent agentic data synthesis and post\-training methods\.AgentSkiller\([Sun et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib25)\)constructs executable environments and synthesizes high\-fidelity multi\-turn interaction trajectories across semantically connected domains, combining structured domain modeling, cross\-domain composition, and execution\-based validation to train generalist agents\.EnvScaler\([Song et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib23)\)programmatically synthesizes tool\-interactive environments and further generates scenarios, tasks, verification functions, and interaction trajectories for supervised fine\-tuning and reinforcement learning\.Klear\-AgentForge\([Wang et al\., 2025a](https://arxiv.org/html/2610.12593#bib.bib28)\)builds general\-purpose agentic models through large\-scale supervised fine\-tuning followed by multi\-turn reinforcement learning, using trajectories distilled or synthesized from strong LLMs together with filtering and verification\.AgenticQwen\([Lyu et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib18)\)adopts iterative data flywheels to progressively increase training difficulty, including an agentic flywheel that expands workflows into multi\-branch behavior structures and converts the resulting branches into new executable tasks for subsequent reinforcement learning\. For these baselines, we evaluate the reported synthetic data or training pipeline using Qwen3\-8B as the downstream task agent for a consistent comparison\.

We additionally construct four synthesis\-variant baselines under the same environment, verifier, task\-agent initialization, training recipe, and evaluation harness\.Monolithic Synthesisremoves the role\-specialized decomposition and directly generates tasks and trajectories with a single synthesis agent\.Fixed\-State Synthesisfreezes the initial synthesis space and allocation, disabling feedback\-driven revision across rounds\.R\-Zero Style\([Huang et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib11)\)uses learner failures as unstructured synthesis guidance without an explicit revisable synthesis space\.AutoPlay Style\([Ramrakhya et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib21)\)uses environment\-grounded trajectory exploration without learner\-feedback\-driven synthesis\-space evolution\.

##### Intrinsic Data\-Quality Metrics\.

We evaluate the verified synthetic data using four deterministic intrinsic metrics, all normalized to\[0,1\]\[0,1\]\. Metrics are computed only on samples whose ground\-truth trajectories successfully replay to full environment reward\. Importantly, all structural factors are re\-derived from the realized ground\-truth tool actions rather than from the synthesis plan, avoiding inflation from intended but unrealized generation targets\. We consider eight observed factors, including task family, tool\-use pattern, expected outcome, state\-change type, computation requirement, numbers of write and read actions, and policy constraints\.

Factor Coverage\.Let𝒱k\\mathcal\{V\}\_\{k\}denote the fixed reference value set of factorkk, and𝒪k\\mathcal\{O\}\_\{k\}the distinct values observed in the verified data\. We measure the fraction of each factor’s reference space that is realized:

FactorCov=1\|𝒦\|​∑k∈𝒦\|𝒪k∩𝒱k\|\|𝒱k\|\.\\mathrm\{FactorCov\}=\\frac\{1\}\{\|\\mathcal\{K\}\|\}\\sum\_\{k\\in\\mathcal\{K\}\}\\frac\{\|\\mathcal\{O\}\_\{k\}\\cap\\mathcal\{V\}\_\{k\}\|\}\{\|\\mathcal\{V\}\_\{k\}\|\}\.\(23\)Higher values therefore indicate broader marginal coverage of controllable interaction factors\. For CAR\-Bench, where marginal factor values saturate across methods, we instead use combinatorial coverage over the joint factor configuration space, computed as the fraction of distinct observed factor cells relative to the union of cells across the compared conditions\.

Factor Balance\.Coverage alone does not reveal whether synthesis is concentrated on only a few values\. For each factorkk, letpkp\_\{k\}denote the empirical distribution over values in𝒱k\\mathcal\{V\}\_\{k\}\. We compute normalized Shannon entropy,

FactorBal=1\|𝒦\|​∑k∈𝒦H⁡\(pk\)log⁡\|𝒱k\|,\\mathrm\{FactorBal\}=\\frac\{1\}\{\|\\mathcal\{K\}\|\}\\sum\_\{k\\in\\mathcal\{K\}\}\\frac\{H\(p\_\{k\}\)\}\{\\log\|\\mathcal\{V\}\_\{k\}\|\},\(24\)whereH⁡\(⋅\)H\(\\cdot\)is Shannon entropy\. A larger value indicates that synthesis mass is distributed more evenly across the factor values\.

Interaction Coverage\.To capture compositional structure beyond individual factors, we measure coverage over predefined pairs of interaction factors\. For each template\(a,b\)∈𝒫\(a,b\)\\in\\mathcal\{P\}, let𝒪a,b\\mathcal\{O\}\_\{a,b\}denote the distinct observed value pairs\. We compute

InteractCov=1\|𝒫\|​∑\(a,b\)∈𝒫\|𝒪a,b\|\|𝒱a\|​\|𝒱b\|\.\\mathrm\{InteractCov\}=\\frac\{1\}\{\|\\mathcal\{P\}\|\}\\sum\_\{\(a,b\)\\in\\mathcal\{P\}\}\\frac\{\|\\mathcal\{O\}\_\{a,b\}\|\}\{\|\\mathcal\{V\}\_\{a\}\|\\,\|\\mathcal\{V\}\_\{b\}\|\}\.\(25\)The templates capture complementary interaction structure such as task family×\\timestool pattern, task family×\\timesoutcome, tool pattern×\\timesstate change, and computation×\\timeswrite complexity\. Higher values indicate richer joint coverage of interaction configurations\.

Trajectory Diversity\.We further characterize the structural diversity of executable trajectories independently of surface language\. Each ground\-truth tool action is mapped to a functional symbol corresponding to*read*,*write*,*compute*, or*transfer*, and consecutive identical symbols are collapsed to form an abstract trajectory pattern\. Letptrajp\_\{\\mathrm\{traj\}\}denote the empirical distribution of these patterns and𝒫union\\mathcal\{P\}\_\{\\mathrm\{union\}\}the union of patterns observed across all compared conditions\. We define

TrajDiv=H⁡\(ptraj\)log⁡\|𝒫union\|\.\\mathrm\{TrajDiv\}=\\frac\{H\(p\_\{\\mathrm\{traj\}\}\)\}\{\\log\|\\mathcal\{P\}\_\{\\mathrm\{union\}\}\|\}\.\(26\)All compared methods and rounds are evaluated against the same𝒫union\\mathcal\{P\}\_\{\\mathrm\{union\}\}, ensuring that the normalized entropy is directly comparable\. Higher values indicate a broader and more evenly distributed set of execution structures\.

##### Initial Task Ontologies

We initialize each domain with a compact, domain\-specific task ontology\. Airline, Retail, and Telecom share the same six ontology axes but use different domain\-specific values\. CAR\-Bench uses seven native axes to better capture vehicle\-state execution, infeasibility, and ambiguity\.

Airline Initial Ontology𝒪0\\mathcal\{O\}\_\{0\}\{ "task\_family": \[ "flight\_booking", "flight\_change", "flight\_cancellation", "refund\_or\_compensation", "seat\_or\_baggage\_service", "loyalty\_or\_membership\_service" \], "expected\_outcome": \[ "fulfill", "refuse" \], "policy\_or\_constraint\_focus": \[ "fare\_rule\_constraint", "change\_or\_cancellation\_fee", "refund\_eligibility", "compensation\_eligibility", "passenger\_or\_identity\_constraint", "time\_window\_constraint", "payment\_or\_credit\_constraint", "loyalty\_status\_constraint" \], "tool\_use\_pattern": \[ "search\_compare\_then\_book", "lookup\_verify\_then\_modify", "multi\_entity\_retrieval", "policy\_check\_before\_action", "price\_or\_fee\_recalculation", "state\_change\_with\_confirmation", "partial\_update\_or\_split\_action" \], "interaction\_challenge": \[ "missing\_information", "ambiguous\_preference", "user\_false\_claim", "preference\_change", "emotional\_pressure", "multi\_intent\_interleaving", "constraint\_hidden\_until\_late" \], "difficulty\_profile": \["easy", "medium", "hard"\] \}

Retail Initial Ontology𝒪0\\mathcal\{O\}\_\{0\}\{ "task\_family": \[ "order\_cancellation", "order\_item\_modification", "order\_logistics\_modification", "return\_delivered\_order", "exchange\_delivered\_order", "profile\_or\_inquiry" \], "expected\_outcome": \["fulfill", "refuse"\], "policy\_or\_constraint\_focus": \[ "order\_status\_precondition", "identity\_authentication", "once\_per\_order\_action\_lock", "product\_variant\_match", "payment\_or\_giftcard\_balance", "confirmation\_requirement", "cancellation\_reason\_validity", "scope\_or\_escalation\_boundary" \], "tool\_use\_pattern": \[ "authenticate\_then\_act", "lookup\_verify\_then\_modify", "multi\_entity\_retrieval", "policy\_check\_before\_action", "price\_or\_refund\_calculation", "state\_change\_with\_confirmation", "batched\_multi\_item\_action" \], "interaction\_challenge": \[ "missing\_information", "ambiguous\_request", "user\_false\_claim", "preference\_change", "emotional\_pressure", "multi\_intent\_interleaving", "constraint\_hidden\_until\_late" \], "difficulty\_profile": \["easy", "medium", "hard"\] \}

Telecom Initial Ontology𝒪0\\mathcal\{O\}\_\{0\}\{ "task\_family": \[ "plan\_change", "billing\_issue", "device\_upgrade", "line\_management", "service\_troubleshooting", "account\_profile\_update" \], "expected\_outcome": \["fulfill", "refuse"\], "policy\_or\_constraint\_focus": \[ "eligibility\_check", "contract\_or\_fee\_constraint", "billing\_or\_payment\_constraint", "identity\_or\_authorization\_constraint", "service\_compatibility\_constraint", "time\_window\_constraint" \], "tool\_use\_pattern": \[ "lookup\_then\_update", "multi\_hop\_retrieval", "compare\_options\_then\_apply", "verify\_before\_action", "diagnose\_then\_resolve", "state\_change\_with\_confirmation" \], "interaction\_challenge": \[ "missing\_information", "ambiguous\_request", "user\_false\_claim", "preference\_change", "emotional\_pressure", "multi\_intent\_interleaving" \], "difficulty\_profile": \["easy", "medium", "hard"\] \}

CAR\-Bench Initial Ontology𝒪0\\mathcal\{O\}\_\{0\}\{ "task\_family": \[ "climate\_control", "window\_and\_body", "navigation", "charging", "communication", "info\_query" \], "task\_nature": \[ "base\_execute", "hallucination\_missing\_tool", "hallucination\_missing\_param", "hallucination\_missing\_result", "disambiguation\_internal", "disambiguation\_user" \], "expected\_behavior": \[ "fulfill\_reach\_goal", "decline\_infeasible", "resolve\_from\_preferences", "clarify\_with\_user" \], "tool\_use\_pattern": \[ "single\_set", "read\_then\_set", "multi\_step\_sequence", "cross\_domain\_compose", "confirmation\_required" \], "state\_precondition": \[ "no\_precondition", "ordering\_dependency", "policy\_guarded", "occupancy\_or\_context\_gated" \], "interaction\_challenge": \[ "cooperative\_clear", "persona\_indirect", "underspecified\_value", "distractor\_context" \], "difficulty\_profile": \["easy", "medium", "hard"\] \}

For Airline, Retail, and Telecom, each task selects exactly onetask\_family, oneexpected\_outcome, one or twopolicy\_or\_constraint\_focusvalues, one to threetool\_use\_patternvalues, zero to twointeraction\_challengevalues, and onedifficulty\_profile\. The difficulty levels correspond to increasing tool\-use and compositional requirements: easy tasks typically require 2–3 tool calls, medium tasks 4–5 calls, and hard tasks 6 or more calls\. For the CAR\-Bench Base experiments,task\_natureis restricted tobase\_execute, whileexpected\_behavioris restricted tofulfill\_reach\_goalandresolve\_from\_preferences\.

##### Representative Agent Prompts\.

To keep the experimental\-details section concise, we defer the representative prompts for the Designer, Planner, and Reflector to Appendix[D](https://arxiv.org/html/2610.12593#A4)\.

### B\.2Additional Overall Performance

We further examine whether the benefits ofEvoSynpersist as the downstream learner scales and how the resulting task agents compare with directly evaluated foundation models\. As shown in Table[4](https://arxiv.org/html/2610.12593#A2.T4), scaling the base Qwen3 backbone from 8B to 14B and 30B raises the average success rate from 39\.4% to 48\.6% and 57\.1%, respectively, while leaving substantial room for post\-training\. Training on evolvedEvoSynexperience consistently closes this gap, with Final\-SFT reaching 77\.8%, 80\.9%, and 86\.0% across the three task\-agent scales\. Crucially, multi\-round synthesis remains beneficial even as the learner becomes substantially stronger: relative to R1, feedback\-guided evolution provides additional gains of 6\.9, 7\.6, and 5\.7 points for Qwen3\-8B, Qwen3\-14B, and Qwen3\-30B, respectively\. These results show that task\-agent scaling and synthesis evolution are complementary rather than interchangeable: larger backbones improve the learner itself, while evolving the synthesized experience continues to provide additional supervision beyond model scale alone\. Most notably, the Qwen3\-30B task agent trained withEvoSynreaches an average success rate of 86\.0%, surpassing the strongest directly evaluated foundation\-model average in the table, Claude Opus 4\.5 at 85\.3%\. This demonstrates that the utility ofEvoSynis not confined to compensating for a weak learner, but persists across substantially different model capacities and can elevate open\-source task agents to frontier\-level performance\.

Table 4:Direct foundation\-model performance and task\-agent scaling results ofEvoSyn\. ForEvoSyn, Claude Opus 4\.5 is used as the synthesis LLM, while Qwen3\-8B, Qwen3\-14B, and Qwen3\-30B serve as downstream task agents\.EvoSyn\-R1 uses first\-round synthesized data, whereasEvoSyn\-Final\-SFT trains on accumulated multi\-round data\.MethodSynthesis LLMTask Agentτ2\\tau^\{2\}\-BenchCAR\-BenchAvg\.AirlineRetailTelecom*Frontier Closed\-source Models*Claude Haiku 4\.5––60\.075\.142\.453\.357\.7Claude Sonnet 4\.5––83\.388\.362\.071\.376\.2Claude Opus 4\.5––79\.391\.888\.082\.085\.3GPT\-5\.2––83\.081\.689\.774\.082\.1Gemini\-3 Flash––82\.576\.891\.269\.380\.1Gemini\-3 Pro––80\.575\.991\.067\.378\.7*Open\-Source Foundation Models*Qwen3\-8B––37\.340\.140\.340\.039\.4Qwen3\-14B––40\.761\.443\.049\.348\.6Qwen3\-30B––62\.075\.441\.849\.357\.1Qwen3\-235B––64\.783\.365\.865\.369\.8*EvoSynTask\-Agent Scaling*EvoSyn\-R1Opus 4\.5Qwen3\-8B64\.878\.379\.860\.770\.9EvoSyn\-Final\-SFTOpus 4\.5Qwen3\-8B71\.383\.683\.972\.677\.8EvoSyn\-R1Opus 4\.5Qwen3\-14B64\.583\.382\.562\.773\.3EvoSyn\-Final\-SFTOpus 4\.5Qwen3\-14B73\.386\.590\.473\.380\.9EvoSyn\-R1Opus 4\.5Qwen3\-30B75\.387\.789\.568\.780\.3EvoSyn\-Final\-SFTOpus 4\.5Qwen3\-30B84\.089\.893\.376\.786\.0

### B\.3Additional Ablation: Why Is a Designer Necessary?

Many agentic synthesis pipelines primarily rely on a Planner–Generator decomposition, where the Planner determines how a task should be constructed and the Generator realizes it in the environment\. We therefore further investigate whether this conventional decomposition is sufficient for self\-evolving synthesis, or whether an explicit Designer is necessary to separate*where to synthesize*from*how to instantiate*each task\. Without the Designer, the Planner must simultaneously perform global task\-space allocation and local task construction\. As shown in Figure[6](https://arxiv.org/html/2610.12593#A2.F6), this coupling causes a severe distributional collapse on Airline:flight\_changeaccounts for93\.6%93\.6\\%of accepted data, while two of the six task families are not covered at all\. Introducing the Designer explicitly separates high\-level synthesis allocation from environment\-grounded task realization\. The resulting data covers all six task families, while the largest family share drops to23\.4%23\.4\\%, yielding substantially more balanced exploration of the task space\. This result clarifies why the Designer is important beyond ordinary Planner–Generator synthesis: it provides the global allocation mechanism required to intentionally explore selected regions of the synthesis space, which is especially important in a self\-evolving pipeline where learner feedback continually changes what should be synthesized next\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/designer_ab.png)Figure 6:Role of the Designer in task\-space exploration onτ2\\tau^\{2\}\-Bench Airline\. A Planner–Generator pipeline without explicit high\-level allocation collapses towardflight\_change, whereas introducing the Designer separates global synthesis allocation from local task construction and restores coverage across all six task families\.
### B\.4Comparative Structural Analysis of Synthetic Data

Beyond downstream task performance, we directly examine how the experience synthesized byEvoSyndiffers from existing synthetic corpora at the data\-structure level\. We conduct three complementary analyses under matched data budgets:*unique structural support*measures whetherEvoSynreaches interaction structures absent from existing corpora,*order\-sensitive contrastive support*evaluates local structural variation among similar action compositions, and*balanced structural diversity*examines how broadly and evenly synthesis mass is distributed across the resulting interaction space\. Together, these analyses characterize not only whetherEvoSyngenerates different data, but whether synthesis\-space evolution progressively expands, enriches, and redistributes the structural support of the training experience\.

#### B\.4\.1Unique and Expanding Structural Support

We further compare the structural support ofEvoSynwith publicly released synthetic corpora constructed for the same environment\. We focus on Airline, whereEvoSyn, AReaL\-SEA\([Gao et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib7)\), APIGen\-MT\([Prabhakar et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib20)\), and WRIT\([Gu et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib9)\)all provide directly domain\-matched synthetic data, and perform all comparisons under matched data budgets\. To account for differences in read\-action logging across released datasets, we canonicalize each example by its*decisive*tool\-interaction sequence, retaining write, compute, and transfer actions\. We define the*unique\-support fraction*as the proportion of a method’s distinct structural signatures that are absent from the pooled support of all other methods\. As shown in Figure[7](https://arxiv.org/html/2610.12593#A2.F7),EvoSyncontributes the largest unique structural support at73\.0%73\.0\\%, compared with69\.0%69\.0\\%for AReaL\-SEA,49\.8%49\.8\\%for APIGen\-MT, and25\.5%25\.5\\%for WRIT\. Its pairwise overlap with these corpora is also small, with Jaccard similarities of only0\.1070\.107–0\.1280\.128\. This indicates thatEvoSynis not simply reproducing structural patterns already present in existing corpora, but contributes a largely complementary set of executable interaction structures under the same data budget\.

More importantly, this complementarity emerges progressively through synthesis\-space evolution\. Relative to the union of all matched baseline corpora, the fraction ofEvoSyn’s support that is baseline\-unseen increases sharply from13\.6%13\.6\\%in R1 to79\.1%79\.1\\%in R2 and remains consistently high through R3 and R4 \(76\.5%76\.5\\%and79\.4%79\.4\\%\)\. Meanwhile, the fraction of individual examples realizing baseline\-unseen structures increases from1\.7%1\.7\\%to15\.0%15\.0\\%\. The sharp transition after the initial round suggests that the gain is not explained by the initial synthesis prior alone: once learner feedback begins revising the synthesis space, subsequent rounds increasingly move generation toward interaction structures absent from existing pipelines\. These results provide direct data\-side evidence that feedback\-guided evolution does more than generate additional variants within a fixed interaction distribution\. Instead, it expands the realized structural support of the training experience and continually redirects synthesis toward previously underrepresented regions of the agentic interaction space\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/baseline_unique_support_airline.png)Figure 7:Structural complementarity ofEvoSynrelative to domain\-matched synthetic\-data baselines on Airline\.Left:fraction of each method’s distinct decisive interaction support that is absent from the pooled support of all other methods under matched data budgets\.EvoSynprovides the largest unique structural contribution\.Right:fraction ofEvoSyn’s structural support that is absent from the union of all matched baseline corpora across synthesis rounds\. Iterative synthesis\-space evolution progressively moves generation toward interaction structures not represented by existing synthesis pipelines\.
#### B\.4\.2Contrastive Support for Order\-Sensitive Interaction Structure

Structural coverage alone does not reveal whether a synthetic corpus captures meaningful variation within similar interaction compositions\. In agentic tasks, examples involving the same or overlapping sets of actions may still require different execution orders, making order\-sensitive contrast an important source of training signal\. We therefore measure whether structurally similar examples exhibit distinct decisive\-action orderings\. Figure[8](https://arxiv.org/html/2610.12593#A2.F8)reports the clearest domain\-matched comparison on Telecom, where decisive\-action traces are directly comparable acrossEvoSynand AReaL\-SEA without the read\-logging asymmetry present in other domains\.EvoSynachieves a tool\-order contrastive support rate of53\.1%53\.1\\%, compared with only9\.6%9\.6\\%for AReaL\-SEA, corresponding to a5\.5×5\.5\\timesincrease\. This indicates thatEvoSynis substantially more likely to realize alternative order\-sensitive interaction structures rather than repeatedly reproducing a single canonical ordering over similar action compositions\. Complementing the unique\-support analysis above, this result shows that synthesis\-space evolution improves not only the global breadth of structural support, but also the local structural variation within that support, exposing execution distinctions that cannot be captured by tool\-set coverage alone\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/contrastive_tool_order_main_v2.png)Figure 8:Order\-sensitive contrastive structure in synthetic data\.Left:On Telecom,EvoSynexhibits substantially higher tool\-order contrastive support than the domain\-matched AReaL\-SEA baseline \(53\.1%53\.1\\%vs\.9\.6%9\.6\\%,5\.5×5\.5\\times\)\.Right:Conceptual illustration of the metric\. Repeated use of the same ordering provides little order\-level contrast, whereas multiple orderings over the same or overlapping action composition create richer order\-sensitive structural variation\.
#### B\.4\.3Balanced Structural Diversity Across Interaction Patterns

Broad structural support does not necessarily imply a useful synthetic distribution: a corpus may contain many distinct interaction patterns while still concentrating most of its mass on a small number of dominant modes\. We therefore complement the support\-based analyses above with distributional measures that quantify how evenly synthesized experience is spread across factors and trajectory structures under matched data budgets\. As shown in Figure[9](https://arxiv.org/html/2610.12593#A2.F9),EvoSynexhibits a particularly strong advantage on Retail, achieving a trajectory\-shape evenness of0\.4600\.460, compared with0\.3420\.342for ToolMind\([Yang et al\., 2025a](https://arxiv.org/html/2610.12593#bib.bib36)\),0\.1480\.148for AReaL\-SEA, and0\.0880\.088for both APIGen\-MT and WRIT\. This represents a1\.35×1\.35\\timesimprovement over the strongest competing method and a3\.12×3\.12\\timesimprovement over AReaL\-SEA, withEvoSyn’s95%95\\%interval \(\[0\.416,0\.500\]\[0\.416,0\.500\]\) remaining disjoint from those of all four baselines\. This result indicates that the additional structures introduced byEvoSynreceive substantial synthesis mass rather than appearing only as isolated long\-tail examples\.

The same distributional advantage is reflected on Telecom, where the compared ground\-truth trajectories admit directly comparable decisive\-action structure\. We additionally report trajectory richness, defined as the fraction of distinct trajectory patterns covered relative to the shared pattern union\. Relative to AReaL\-SEA,EvoSynachieves higher factor balance \(0\.4270\.427vs\.0\.3780\.378\), interaction coverage \(0\.3720\.372vs\.0\.3310\.331\), trajectory richness \(1\.0001\.000vs\.0\.6780\.678\), and trajectory evenness \(0\.3920\.392vs\.0\.2930\.293\)\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/balanced_structural_diversity.png)Figure 9:Balanced structural diversity of synthetic agent data\.Left:On Retail,EvoSynachieves the highest trajectory\-shape evenness among five domain\-matched synthetic corpora under the same data budget, exceeding the strongest competing method by1\.35×1\.35\\timesand AReaL\-SEA by3\.12×3\.12\\times\.Right:On Telecom, where the compared ground\-truth traces have directly comparable decisive\-action structure,EvoSynprovides higher factor balance, interaction coverage, trajectory richness, and trajectory evenness than AReaL\-SEA\. Together, these results show thatEvoSyndistributes synthesis mass across a broader and more balanced set of interaction structures rather than concentrating on a small number of dominant trajectory patterns\.

### B\.5Targeted Slice Statistics for Capability\-Gap Adaptation

Table[5](https://arxiv.org/html/2610.12593#A2.T5)provides the slice\-level statistics underlying the two capability\-gap transitions visualized in Figure[5](https://arxiv.org/html/2610.12593#S5.F5)and Figure[10](https://arxiv.org/html/2610.12593#A2.F10)\. For each transition, we examine interaction slices associated with the promoted synthesis factor or explicitly emphasized by the next\-round Designer allocation\. During R1→\\rightarrowR2, the learner exhibits large gaps on write\-heavy interactions:multi\_writeandhigh\_writehave capability gaps of0\.5710\.571and0\.6670\.667\. Their verified\-data proportions subsequently increase by0\.3400\.340and0\.1450\.145, followed by success\-rate gains of0\.2620\.262and0\.3890\.389, respectively\. After this write\-heavy weakness is reduced, R2→\\rightarrowR3 shifts toward read\-intensive decision making, as shown in Figure[10](https://arxiv.org/html/2610.12593#A2.F10)\.navigation,multi\_read, andread\_then\_setreceive substantial increases in synthesis allocation and all improve after training, yielding gains of0\.1480\.148,0\.2050\.205, and0\.1030\.103\.

The aggregate statistics further quantify this feedback\-to\-decision alignment\. In R2→\\rightarrowR3, pre\-round capability gaps are strongly aligned with next\-round synthesis shifts \(Spearmanρ=0\.964\\rho=0\.964\), indicating that synthesis effort is systematically redirected toward regions where the learner remains weak\. All directly upweighted slices improve after the corresponding training round, giving targeted improvement rates of2/22/2for R1→\\rightarrowR2 and3/33/3for R2→\\rightarrowR3\. The positive allocation–gain association in R2→\\rightarrowR3 \(ρ=0\.750\\rho=0\.750\) provides additional descriptive evidence that these targeted shifts coincide with subsequent capability improvement\. These slice\-level results show thatEvoSynfollows a moving capability boundary rather than repeatedly oversampling a fixed notion of task difficulty\.

Table 5:Targeted capability evolution on CAR\-Bench Base\. We report the promoted or directly targeted slices in each transition\.Δ\\DeltaProp measures the change in verified synthetic\-data proportion from the current round to the next round, and Gain measures the corresponding held\-out success\-rate change after training\.TransitionTargeted SlicePre\-round SRCapability GapΔ\\DeltaPropPost\-round GainTargeted ImprovementR1→\\rightarrowR2multi\_write0\.4290\.571\+0\.340\+0\.262✓high\_write0\.3330\.667\+0\.145\+0\.389✓R2→\\rightarrowR3navigation0\.4630\.537\+0\.690\+0\.148✓multi\_read0\.4100\.590\+0\.804\+0\.205✓read\_then\_set0\.5900\.410\+0\.354\+0\.103✓R1→\\rightarrowR2 aggregateAllocation–Gainρ=0\.571\\rho=0\.571Targeted Improvement Rate=2/2=2/2R2→\\rightarrowR3 aggregateGap–Allocationρ=0\.964\\rho=0\.964Allocation–Gainρ=0\.750\\rho=0\.750, TIR=3/3=3/3

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/rq4_car_capability_evolution_v2_r2_r3.png)Figure 10:Capability\-gap\-driven synthesis adaptation on CAR\-Bench from R2 to R3\. As the learner’s residual weakness shifts toward read\-intensive decision making,EvoSynsubstantially increases the verified\-data share ofnavigation,multi\_read, andread\_then\_set, all of which subsequently improve after training\.
### B\.6No\-Feedback Control for Synthesis\-Space Expansion

We further test whether the factors introduced during synthesis\-space expansion are genuinely driven by learner feedback or could be recovered through generic reasoning over the synthesis space and environment alone\. For each CAR\-Bench transition, we compare the feedback\-conditioned Reflector with a no\-feedback control that receives the same synthesis interface, environment description, and tool schema, but no post\-training failures, coverage statistics, diagnostic probes, or learner\-feedback summaries\. As shown in Table[6](https://arxiv.org/html/2610.12593#A2.T6), the feedback\-conditioned Reflector identifies both factors subsequently adopted byEvoSyn:num\_writeafter R1 andnum\_readafter R2\. These factors are also operationally reflected in the next\-round data, with the verifiedmulti\_writeshare increasing from0\.2320\.232to0\.5710\.571and themulti\_readshare from0\.0560\.056to0\.8600\.860\.

In contrast, the no\-feedback control proposes six semantically plausible dimensions, including temporal reasoning, entity resolution, constraint interaction, information synthesis, and target resolution, but none recovers the write\- or read\-volume factors that are actually exposed by the learner’s measured failures\. The resulting adopted\-factor recovery is therefore2/22/2with feedback versus0/60/6without feedback\. This control shows that synthesis\-space expansion is not equivalent to asking a strong LLM to invent additional task dimensions: learner feedback identifies the specific missing coordinate along which the current task agent fails, allowing the Reflector to convert that weakness into a reusable and actionable generation control\.

Table 6:Detailed no\-feedback control for Reflector breadth on CAR\-Bench Base\. The feedback\-conditioned Reflector uses empirical failure and coverage evidence, while the no\-feedback control receives only the ontology, environment description, and tool schema\.TransitionEmpirical Feedback SignalFeedback\-Conditioned DiscoveryAdoption EvidenceNo\-Feedback ProposalsControl OutcomeR1→\\rightarrowR2Tasks with 5\+ write actions have high failure, indicating that write\-action quantity is a missing difficulty coordinate beyond the coarse tool\_use\_pattern dimension\.Promotes num\_write with buckets \{0, 1, 2, 3–4, 5\+\}\. The factor is novel, evidence\-grounded, actionable, and adopted\.num\_write is added to the next synthesis interface\. The verified multi\_write share increases from 0\.232 to 0\.571\.temporal\_reasoning\_depth, entity\_resolution\_complexity, constraint\_interaction\.Misses the adopted write\-volume factor; 0/3 proposals recover the adopted write\-volume factor\.R2→\\rightarrowR3Tasks with 3–4 read actions have high failure and low coverage, exposing an under\-sampled read\-heavy decision region\.Promotes num\_read with buckets \{0, 1, 2, 3–4, 5\+\}\. The factor is novel, evidence\-grounded, actionable, and adopted\.num\_read is added to the next synthesis interface\. The verified multi\_read share increases from 0\.056 to 0\.860\.temporal\_reasoning, information\_synthesis\_depth, target\_resolution\.Misses the adopted read\-volume factor; 0/3 proposals recover the adopted read\-volume factor\.OverallFeedback\-conditioned Reflector: 2 proposed factors, both evidence\-grounded and both adopted\.No\-feedback control: 6 proposed factors, none grounded in observed failure or coverage evidence, and none matching the adopted write/read\-volume factors\.Adopted\-factor recovery: 2/2 vs\. 0/6\.

### B\.7Controllability of Evolved Synthesis Factors

A revisable synthesis space is useful only if its factors serve as actionable generation controls rather than post\-hoc descriptors of generated data\. We therefore test whether a factor value specified before generation is faithfully realized in the resulting environment\-grounded trajectory\. We usenum\_writeas a representative directly measurable factor: for each blueprint–task pair, we recover the requested value from the synthesis plan and independently recompute the realized value from the ground\-truth tool trajectory\. To isolate generation controllability from round\-wise evolution, we evaluate R2 synthesis runs across multiple domains and synthesis backbones\. As shown in Table[7](https://arxiv.org/html/2610.12593#A2.T7), requested and realized values exhibit near\-perfect agreement in every setting, with exact\-match accuracy of99\.699\.6–100%100\\%and Spearmanρ=0\.997\\rho=0\.997–1\.0001\.000across thousands of blueprint–task pairs\. Importantly, this agreement is not an artifact of the Verifier filtering non\-conforming generations: the explicit axis\-conformance check rejects only0\.15%0\.15\\%of candidates in Retail and1\.0%1\.0\\%in CAR\-Bench, while candidates rejected for unrelated reasons still retain requested–realized agreement of100%100\\%and98\.3%98\.3\\%, respectively\. These results show that the synthesis pipeline can reliably translate an abstract factor specification into the intended interaction structure, supporting the synthesis space as an operational control interface for feedback\-driven allocation and evolution\.

Table 7:Controllability of the synthesis coordinate across R2 synthesis runs\. We compare the value requested in the synthesis plan with the value independently recomputed from the realized ground\-truth trajectory\.DomainSynthesis LLMExact MatchSpearmanρ\\rhoCAR\-BenchClaude Opus 4\.599\.6%0\.998RetailClaude Opus 4\.5100\.0%1\.000AirlineQwen3\-30B100\.0%1\.000CAR\-BenchQwen3\-235B99\.7%0\.997
### B\.8Capability\-Gap Alignment of Synthesis Reallocation

We further examine whether feedback\-driven synthesis reallocation is systematically aligned with the learner’s residual capability gaps rather than being driven by a small number of selected cases\. We focus on the CAR\-Bench R2→\\rightarrowR3 transition and evaluate all seven measurable interaction slices\. For each slice, we define the pre\-round capability gap as1−SRR​21\-\\mathrm\{SR\}\_\{R2\}and quantify the next\-round synthesis shift by the change in its proportion of verified synthetic data\. As shown in Figure[11](https://arxiv.org/html/2610.12593#A2.F11), the two quantities are strongly correlated \(Spearmanρ=0\.964\\rho=0\.964, 95% CI\[0\.70,1\.00\]\[0\.70,1\.00\], permutationp=0\.003p=0\.003\)\. Interaction slices with larger residual gaps, such asmulti\_readandnavigation, receive substantially greater synthesis emphasis, whereas regions in which the learner is already stronger are generally downweighted\. In contrast, under the Fixed\-State Synthesis baseline, the same learner\-side capability gaps are negatively correlated with subsequent changes in data proportion \(ρ=−0\.964\\rho=\-0\.964\), indicating that simply accumulating additional synthetic data does not reproduce this learner\-aligned redistribution\. The observed reallocation is also consistent with subsequent learning outcomes\. All three slices that receive increased synthesis emphasis in R3, namelymulti\_read,navigation, andread\_then\_set, improve after training by\+0\.205\+0\.205,\+0\.148\+0\.148, and\+0\.103\+0\.103, respectively\. These results provide direct evidence thatEvoSyntranslates residual learner weaknesses into targeted synthesis decisions and continuously redirects future experience as the learner’s capability boundary changes\.

![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/C_gap_vs_allocation.png)Figure 11:Capability\-gap\-driven synthesis reallocation on CAR\-Bench from R2 to R3\. Each point denotes an interaction slice\. The pre\-round capability gap \(1−SRR​21\-\\mathrm\{SR\}\_\{R2\}\) is strongly aligned with the subsequent change in synthesis allocation \(Spearmanρ=0\.964\\rho=0\.964, 95% CI\[0\.70,1\.00\]\[0\.70,1\.00\], permutationp=0\.003p=0\.003\), showing thatEvoSynshifts synthesis effort toward regions where the current learner remains weak\.
### B\.9Structural Support Expansion Across Synthesis Rounds

We next examine whether synthesis\-space evolution expands the structural support of the generated experience or simply produces additional samples within an already covered interaction regime\. To abstract away surface\-level linguistic variation, we represent each verified example by its ground\-truth tool\-call sequence and measure the cumulative number of distinct interaction sequences\. As shown in Table[8](https://arxiv.org/html/2610.12593#A2.T8),EvoSynexhibits sustained structural growth across synthesis rounds, whereas Static synthesis increasingly saturates\. On CAR\-Bench, the number of distinct sequences grows from 270 in R1 to 497 in R2 and 952 in R3 underEvoSyn, while Static reaches only 415 by R3\. The contrast is even sharper on Airline, whereEvoSynexpands from 28 to 111 and 122 sequences across rounds, compared with only 36 for Static at R3\. This divergence indicates that laterEvoSynrounds continue to introduce new executable interaction structures rather than repeatedly sampling from the support established in earlier rounds\.

Because the cumulativeEvoSynpools contain more accepted examples, we further control for data volume through size\-matched subsampling at the final round\. For each domain, we subsample theEvoSynpool to exactly match the number of accepted examples in Static and recompute structural support\. Figure[12](https://arxiv.org/html/2610.12593#A2.F12)shows that the advantage remains substantial: at the sameN=1,287N=1\{,\}287,EvoSyncovers 549\.7 distinct sequences on CAR\-Bench compared with 415\.0 for Static, a1\.32×1\.32\\timesincrease\. On Airline, it covers 78\.8 sequences versus 36\.0 at the sameN=1,065N=1\{,\}065, corresponding to a2\.19×2\.19\\timesincrease\. The persistence of this gap after controlling for sample count shows that the structural expansion cannot be explained by data accumulation alone\. Instead, revising the synthesis state changes the support of the generated experience, enabling controllable interaction factors to be realized through a broader set of executable behaviors\.

Table 8:Structural\-support growth across synthesis rounds\. We report the cumulative number of distinct ground\-truth tool\-call sequences covered by the verified synthetic data\.DomainMethodR1R2R3CAR\-BenchEvoSyn270497952Static276398415AirlineEvoSyn28111122Static232736![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/D_size_matched_structural_support.png)Figure 12:Size\-matched structural support at the final synthesis round\. The cumulativeEvoSynpool is subsampled to match the number of accepted examples in the Static baseline, and structural support is measured by the number of distinct ground\-truth tool\-call sequences\. After controlling for data volume,EvoSynstill covers1\.32×1\.32\\timesmore interaction sequences on CAR\-Bench and2\.19×2\.19\\timesmore on Airline\.
### B\.10Do Promoted Factors Capture Previously Unmodeled Learner Weakness?

We next examine whether factors introduced during synthesis\-space expansion capture genuine learner weaknesses that are not adequately represented by the current synthesis space\. For each promoted factor, we retrospectively annotate the corresponding interaction property on held\-out evaluation tasks and analyze the learner*before*that factor is added, so that the diagnosis is not confounded by subsequent factor\-guided synthesis or training\. To quantify the additional failure signal carried by the promoted coordinate, we compute the conditional mutual informationI⁡\(Yfail;dnew∣𝒪r\)I\(Y\_\{\\mathrm\{fail\}\};d\_\{\\mathrm\{new\}\}\\mid\\mathcal\{O\}\_\{r\}\), where𝒪r\\mathcal\{O\}\_\{r\}denotes the synthesis space before promotion\. This quantity measures how much information about learner failure remains attributable to the new factor after conditioning on the interaction factors already represented in the current synthesis space\.

As shown in Table[9](https://arxiv.org/html/2610.12593#A2.T9), the promoted factors retain substantial additional failure information across representative expansion cases\. On Airline,num\_writecontributes 0\.122 nats beyond the existing synthesis coordinates\. On CAR\-Bench, the corresponding values are 0\.168 nats fornum\_writeand 0\.134 nats fornum\_read\. These positive values indicate that the promoted factors are not redundant with the pre\-existing synthesis representation\. Instead, they capture residual failure\-relevant structure that remains visible even after accounting for the factors already available to the synthesizer\.

Figure[13](https://arxiv.org/html/2610.12593#A2.F13)provides an intuitive illustration on Airline\. Beforenum\_writeis introduced as an explicit synthesis coordinate, the learner’s failure rate rises sharply with the number of required write actions, increasing from 0\.18 for tasks with no write action to 1\.00 for tasks with five or more, with a positive task\-level rank association ofρ=0\.459\\rho=0\.459\. Because all measurements are taken from the pre\-promotion learner, this pattern reflects a capability gap that precedes and motivates the later synthesis\-space revision\. The result therefore supports a stronger interpretation than post\-hoc relabeling: promoted factors expose previously unmodeled failure structure and convert it into actionable synthesis coordinates for subsequent rounds\.

Table 9:Residual learner\-failure information captured by promoted synthesis factors\. All statistics are computed using the learner before the corresponding factor is introduced\. Conditional mutual information measures the additional failure information provided by the promoted factor after conditioning on the existing synthesis space𝒪r\\mathcal\{O\}\_\{r\}\.DomainPromoted Factor𝐈⁡\(𝐘fail;𝐝new∣𝒪𝐫\)\\mathbf\{I\(Y\_\{\\mathrm\{fail\}\};d\_\{\\mathrm\{new\}\}\\mid\\mathcal\{O\}\_\{r\}\)\}\(nats\)Airlinenum\_write0\.122CAR\-Benchnum\_write0\.168CAR\-Benchnum\_read0\.134![Refer to caption](https://arxiv.org/html/2610.12593v1/figures/A_airline_num_write_failure_gradient.png)Figure 13:Pre\-promotion learner failure rate acrossnum\_writebuckets on Airline\. Tasks requiring more state\-changing write actions are substantially more failure\-prone beforenum\_writeis introduced as an explicit synthesis coordinate, with a positive task\-level association between write complexity and learner failure \(Spearmanρ=0\.459\\rho=0\.459, 95% CI\[0\.32,0\.59\]\[0\.32,0\.59\]\)\.
### B\.11Do Promoted Factors Capture Failure Structure Beyond Generic Complexity?

A natural alternative explanation for synthesis\-space expansion is that the promoted factors merely recover generic task difficulty\. For example, tasks requiring more reads or writes may simply involve longer tool\-use trajectories and therefore be harder for the learner\. We test this hypothesis by using the total number of tool calls, discretized into tertile\-based buckets, as a domain\-agnostic complexity variablegg\. For each promoted factorzz, we measure its dependence on generic complexity usingNMI⁡\(z,g\)\\mathrm\{NMI\}\(z,g\)and quantify the residual failure information it provides after conditioning onggthroughI⁡\(Yfail;z∣g\)I\(Y\_\{\\mathrm\{fail\}\};z\\mid g\)\.

As shown in Table[10](https://arxiv.org/html/2610.12593#A2.T10), Airlinenum\_writeis only weakly associated with overall tool count \(NMI=0\.216\\mathrm\{NMI\}=0\.216\), yet retains0\.2410\.241nats of failure information after generic complexity is known, compared with only0\.0320\.032nats carried by tool count itself\. CAR\-Benchnum\_readshows a moderate association with tool count \(NMI=0\.420\\mathrm\{NMI\}=0\.420\), but still contributes0\.0750\.075nats of residual failure information beyond it\. These results show that the promoted factors are not redundant proxies for trajectory length or overall interaction complexity\. Instead, they identify more specific failure\-relevant interaction properties, supporting synthesis\-space expansion as a mechanism for exposing structured capability gaps rather than merely generating globally harder tasks\.

Table 10:Promoted synthesis factors capture learner\-failure structure beyond generic interaction complexity\. We use the total number of tool calls as a domain\-agnostic complexity variablegg\. All information quantities are reported in nats\.DomainPromoted FactorzzNMI⁡\(𝐳,𝐠\)\\mathbf\{\\mathrm\{NMI\}\(z,g\)\}𝐈⁡\(𝐘fail,𝐠\)\\mathbf\{I\(Y\_\{\\mathrm\{fail\}\};g\)\}𝐈⁡\(𝐘fail;𝐳∣𝐠\)\\mathbf\{I\(Y\_\{\\mathrm\{fail\}\};z\\mid g\)\}Airlinenum\_write0\.2160\.0320\.241CAR\-Benchnum\_read0\.4200\.1090\.075
### B\.12Observed Marginal Learning Gain Across Synthesis Rounds

We further examine how downstream improvement changes as new verified experience is introduced across synthesis rounds\. Because both the learner state and training\-data composition evolve over time, this analysis is descriptive rather than a causal estimate of per\-example utility\. We normalize the observed change in task success by the amount of newly added verified training data\. As shown in Table[11](https://arxiv.org/html/2610.12593#A2.T11), the CAR\-Bench R1→\\rightarrowR2 transition improves success rate by\+0\.020\+0\.020with approximately0\.970\.97K additional examples, corresponding to an observed gain of\+0\.021\+0\.021per 1K examples\. In comparison, R2→\\rightarrowR3 improves success by\+0\.120\+0\.120with only0\.780\.78K additional examples, yielding\+0\.153\+0\.153per 1K examples\. This is approximately seven times the normalized gain observed in the preceding round\. Notably, R2→\\rightarrowR3 is also the transition in which synthesis is redirected toward the learner’s newly exposed read\-heavy capability gaps, linking the strongest synthesis\-space revision with the largest observed learning return from newly added experience\.

The endpoint comparison provides a complementary view after accounting for cumulative training\-set size\. Relative to the base Qwen3\-8B agent,EvoSynR3 gains0\.4000\.400success\-rate points using 1,996 verified examples, corresponding to\+0\.200\+0\.200per 1K examples, compared with\+0\.210\+0\.210and\+0\.163\+0\.163per 1K for Static\. While these ratios should not be interpreted as intrinsic sample\-level utility, they provide additional evidence that feedback\-guided synthesis can improve not only the amount and structural coverage of training experience, but also the observed learning return associated with later synthesis rounds\.

Table 11:Observed marginal learning gain on CAR\-Bench\. Round\-wise gain is normalized by the number of newly added verified examples; endpoint efficiency is measured relative to the base Qwen3\-8B agent \(SR=0\.360\\mathrm\{SR\}=0\.360\)\.Transition𝚫\\mathbf\{\\Delta\}SRAdded Examples𝚫\\mathbf\{\\Delta\}SR / 1KR1→\\rightarrowR2\+0\.0200\.97K\+0\.021R2→\\rightarrowR3\+0\.1200\.78K\+0\.153Final endpoint efficiency relative to the base agentEvoSynR3\+0\.4001\.996K\+0\.200Static R3\+0\.2101\.287K\+0\.163
### B\.13Evolution Case Study

#### B\.13\.1Car\-Bench

Table[12](https://arxiv.org/html/2610.12593#A2.T12)quantitatively verifies the multi\-round evolution illustrated in Figure[4](https://arxiv.org/html/2610.12593#S5.F4)\. Both Static Multi\-Round andEvoSynstart from the same R1 data, isolating the effect of feedback\-driven synthesis decisions in later rounds\. Static Multi\-Round continues to add data under a fixed synthesis interface and allocation, but its downstream performance does not improve consistently, moving from 0\.607 to 0\.627 and then dropping to 0\.613\. In contrast,EvoSynimproves monotonically from 0\.607 to 0\.655 and finally to 0\.726, suggesting that later rounds become increasingly useful for task\-agent learning rather than merely larger in size\. The intrinsic metrics show the same pattern\. By R3,EvoSynachieves substantially higher factor coverage than Static Multi\-Round \(0\.893 vs\. 0\.787\) and much higher trajectory\-pattern diversity \(0\.938 vs\. 0\.750\), while also improving factor balance and interaction coverage\. These results support the mechanism behindEvoSyn: post\-training feedback does not only evaluate the current synthetic pool, but changes the controllable synthesis interface and redirects subsequent generation toward interaction regions that static sampling fails to cover effectively\.

Table 12:Intrinsic quality of synthetic data over rounds on CAR\-Bench Base\. Each row is computed on the cumulative data up to the corresponding round\. All intrinsic metrics are normalized to\[0,1\]\[0,1\], where higher is better\.SettingRoundFactorCoverageFactorBalanceInteractionCoverageTrajectory PatternDiversitySuccess RateStatic Multi\-RoundR10\.6400\.4920\.3390\.6880\.607R20\.7050\.4700\.3430\.7350\.627R30\.7870\.4680\.3510\.7500\.613EvoSynR10\.6400\.4920\.3390\.6880\.607R20\.7600\.4790\.3510\.7500\.655R30\.8930\.5080\.3730\.9380\.726

Table[13](https://arxiv.org/html/2610.12593#A2.T13)provides the detailed evidence behind the CAR\-Bench evolution trace shown in Figure[3](https://arxiv.org/html/2610.12593#S5.F3)\. The table expands each round transition into four components: the post\-training feedback observed after the previous round, the Reflector’s ontology decision, the Designer’s next\-round synthesis focus, and the resulting synthesis change\. In the R1→\\rightarrowR2 transition, the key signal is a failure concentration in write\-heavy vehicle\-control tasks: the 5\+ write bucket has a failure rate of 0\.92, while the initial interface only represents coarse tool\-use patterns and cannot directly control the number of state\-changing actions\. The Reflector therefore promotesnum\_write, allowing the Designer to allocate synthesis budget toward high\-write trajectories\. In the R2→\\rightarrowR3 transition, feedback shows that the write dimension has become meaningful, but a new gap appears in read\-heavy tasks: thenum\_read=3–4 bucket has a failure rate of 0\.63 while covering only 3\.9% of the data\. The Reflector consequently promotesnum\_read, shifting the next round toward read\-heavy trajectories\. This detailed trace supports the interpretation thatEvoSynevolves by converting post\-training feedback into new controllable synthesis dimensions, rather than merely resampling more tasks from a fixed interface\.

Table 13:Mechanistic trace of learning\-guided synthesis evolution on CAR\-Bench Base\. Each row reports the concrete feedback evidence used by the Reflector, the resulting ontology decision, the Designer’s budget shift, and the observed synthesis change\.TransitionFeedback EvidenceReflector DecisionDesigner FocusObserved Synthesis ChangeR1→\\rightarrowR2R1 evaluation shows that the hardest cases concentrate in high\-write vehicle\-control tasks: the 5\+ write bucket has failure rate 0\.92\. The R1 data is skewed toward lower write counts \(1 write: 54%; 2 writes: 14%; 3–4 writes: 16%; 5\+ writes: 16%\)\. The existingtool\_use\_patterndimension captures action\-sequence shape, but not the quantity of state\-changing writes\.Promotenum\_write\_actionsinto a new controllable dimensionnum\_write\. This separates write\-action quantity from the existing tool\-pattern dimension and introduces a new axis for execution\-heavy tasks\.Increase synthesis budget for high\-write regions, especiallynum\_write=3–4 and 5\+, under the base\-only CAR environment with a weak macro prior\.R2 generates multi\-write vehicle\-control tasks that the initial interface could not directly target\. The round accepts 971 verified tasks, bringing the cumulative verified set to 1212\.R2→\\rightarrowR3After R2, thenum\_writeaxis is validated: failure on 5\+ write tasks drops from 0\.92 to 0\.53, and the failure gradient becomes monotonic across write\-count buckets\. New feedback shows that read\-heavy tasks remain both difficult and under\-covered:num\_read=3–4 has failure rate 0\.63 but only 3\.9% coverage\.Promotenum\_writefrom experimental to standard\. Promotenum\_readinto a new controllable axis with buckets 0/1/2/3–4/5\+\. The new axis is considered orthogonal tonum\_write, since read actions correspond to information gathering and decision preparation, while write actions correspond to execution\.Shift macro budget toward the under\-covered high\-failure read region, especiallynum\_read=3–4, while keepingnum\_writeas a standard seed dimension\.R3 produces read\-heavy trajectories: the average number of reads increases to 5\.02 per task, compared with 0\.97 in R2\. The round accepts 784 verified tasks and expands the data toward read–decide–act interactions\.

#### B\.13\.2Tau\-Bench Airline

The Airline domain provides a complementary case of learning\-guided synthesis evolution in a customer\-service environment with richer policy constraints and state\-changing operations\. As shown in Table[15](https://arxiv.org/html/2610.12593#A2.T15),EvoSynfirst identifies a strong distributional and capability mismatch after R1: the verified data is dominated byflight\_changetasks, while high\-write interactions remain under\-represented and difficult\. The Reflector therefore promotesnum\_writeinto a controllable dimension, allowing the Designer to explicitly allocate R2 synthesis budget toward multi\-write trajectories\. After this axis becomes operational, the next round reveals a different source of difficulty: numerical or derived tool arguments that require computation before execution\. The Reflector then promotescomputationas a new synthesis dimension, and R3 shifts toward more balanced coverage of computation\-aware interactions\. This trace supports the same mechanism observed in CAR\-Bench: feedback does not merely filter generated tasks, but changes the coordinates along which future tasks can be deliberately synthesized\.

Table[14](https://arxiv.org/html/2610.12593#A2.T14)further shows that this mechanism translates into stronger multi\-round behavior than Static Multi\-Round synthesis\. Both methods start from the same R1 data, but Static Multi\-Round only accumulates more samples under a fixed interface and allocation, leading to unstable performance from 0\.648 to 0\.633 and then 0\.660\. In contrast,EvoSynimproves steadily from 0\.648 to 0\.693 and finally to 0\.713\. The intrinsic data\-quality metrics show a similar divergence: by R3,EvoSynachieves higher factor coverage, factor balance, interaction coverage, complexity coverage, and trajectory\-pattern diversity than the static baseline\. The largest gap appears in trajectory\-pattern diversity, whereEvoSynreaches 0\.769 compared with 0\.538 for Static Multi\-Round, indicating that feedback\-guided evolution expands not only the labels attached to synthetic tasks but also the underlying tool\-use and state\-transition structures\. Together with the CAR\-Bench results in the main text, this Airline case suggests that the self\-evolution loop generalizes across domains: later rounds become more useful because the synthesis process itself is revised according to observed failures, coverage gaps, and newly exposed interaction factors\.

Table 14:Intrinsic quality of synthetic data over rounds onτ2\\tau^\{2\}\-Bench Airline\. Each row is computed on the cumulative data up to the corresponding round\. All metrics are normalized to\[0,1\]\[0,1\], where higher is better\.SettingRoundFactorCoverageFactorBalanceInteractionCoverageTrajectory PatternDiversitySuccess RateStatic Multi\-RoundR10\.7420\.2640\.3110\.4620\.648R20\.7600\.3090\.3300\.5380\.633R30\.7780\.3680\.4030\.5380\.660EvoSynR10\.7420\.2640\.3110\.4620\.648R20\.7850\.4530\.3990\.6920\.693R30\.8910\.4500\.4550\.7690\.713

Table 15:Mechanistic trace of learning\-guided synthesis evolution onτ2\\tau^\{2\}\-Bench Airline\. Each row reports the concrete feedback evidence used by the Reflector, the resulting ontology decision, the Designer’s budget shift, and the observed synthesis change\.TransitionFeedback EvidenceReflector DecisionDesigner FocusObserved Synthesis ChangeR1→\\rightarrowR2R1 data is highly skewed:flight\_changeaccounts for 93\.6% of verified tasks\. Failure probes further show that the 3–4 write\-action bucket has failure rate 1\.00, indicating that high\-write state\-changing interactions are difficult but not explicitly controllable in the initial interface\.Promotenum\_write\_actionsinto a new controllable axisnum\_writewith buckets 0/1/2/3–4/5\+\. The axis is introduced as a failure\-driven experimental dimension because the probe shows strong failure correlation and is generator\-realizable\.Increase macro budget for the previously under\-covered high\-write buckets, especiallynum\_write=3–4 and 5\+\. Lower write\-count buckets remain medium priority\.R2 blueprints shift strongly toward high\-write synthesis: the 3–4 and 5\+ buckets together account for 57% of realized blueprints\. Accepted tasks span all five write\-count buckets, showing thatnum\_writebecomes an operational synthesis control rather than only a diagnostic label\.R2→\\rightarrowR3After R2,num\_writeis validated as a meaningful factor: the 5\+ write bucket remains difficult with failure rate 0\.86, while write\-count coverage becomes healthier\. A new probe,num\_numeric\_fields, shows failure rate 1\.00 at value 1, revealing difficulty with numerical or derived tool arguments before execution\.Promotenum\_writefrom experimental to standard\. Then promotenum\_numeric\_fieldsinto a new semantic axiscomputation, with valuesnone,aggregate,constrained\_opt, andconditional\.Tilt macro budget toward all four buckets of the newcomputationaxis\. The goal is to systematically explore different forms of computation\-before\-action behavior while retainingnum\_writeas a standard dimension\.R3 blueprints become approximately balanced across computation types, with each computation bucket covering about one quarter of the realized blueprint distribution\. The synthesis focus therefore shifts from only controlling write\-action complexity to also covering numerical decision\-making and conditional tool execution\.

## Appendix CRelated Work

### C\.1Synthetic Data for Post\-Training and Self\-Evolution

Synthetic data has become a major mechanism for expanding the supervision available to large language models beyond manually curated datasets\. A broad line of work studies how to bootstrap instruction\-following data from seed tasks, teacher models, unlabeled corpora, or model\-generated responses, including Self\-Instruct\([Wang et al\., 2023](https://arxiv.org/html/2610.12593#bib.bib31)\), WizardLM\([Xu et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib35)\), and instruction backtranslation\([Li et al\., 2023](https://arxiv.org/html/2610.12593#bib.bib14)\)\. Subsequent methods improve the diversity, realism, and usefulness of synthetic corpora through multi\-agent simulation, feature\-targeted generation, filtering, or autonomous data engineering\([Tang et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib26);[Li et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib15);[Cao et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib1);[He et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib10);[Tu et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib27)\)\. These approaches establish synthetic data as a central ingredient in LLM post\-training\. However, most of them treat data generation as an offline construction process: a corpus is generated, filtered, and then used to train a learner, while the synthesis process itself is only weakly coupled to the learner’s post\-training behavior\.

Reasoning domains provide a particularly favorable setting for scalable synthetic supervision because many examples admit verifiable answers or checkable solution traces\. STaR\([Zelikman et al\., 2022](https://arxiv.org/html/2610.12593#bib.bib42)\)bootstraps rationales from successful model attempts, while WizardMath\([Luo et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib17)\), MetaMath\([Yu et al\., 2023](https://arxiv.org/html/2610.12593#bib.bib39)\), MAmmoTH\([Yue et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib40)\), and ToRA\([Gou et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib8)\)expand mathematical or tool\-integrated reasoning supervision through instruction evolution, problem transformation, and rationale construction\. Large\-scale mathematical post\-training pipelines such as DeepSeekMath\([Shao et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib22)\)and NuminaMath\([Li et al\., 2024](https://arxiv.org/html/2610.12593#bib.bib13)\)further demonstrate the effectiveness of combining synthesized or curated reasoning data with outcome verification\. More recent learner\-aware methods use model behavior to guide synthesis: for example, SwS\([Liang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib16)\)identifies persistent weaknesses and generates new problems around the corresponding concepts\. Together, these works show that verifiability and learner feedback can substantially improve synthetic data quality\. Nevertheless, their feedback signals are usually mapped to harder problems, corrected rationales, or concept\-level variants within a relatively self\-contained problem space\.

A related line of work studies self\-evolving LLMs, where task generation and task solving are placed in a feedback loop\([Yang et al\., 2025b](https://arxiv.org/html/2610.12593#bib.bib38)\)\. R\-Zero\([Huang et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib11)\)co\-evolves a Challenger and Solver through generated problems and solution feedback, and Socratic\-Zero\([Wang et al\., 2025b](https://arxiv.org/html/2610.12593#bib.bib30)\)introduces Teacher, Solver, and Generator roles to construct an increasingly challenging curriculum from diagnosed learner weaknesses\. Agent0\([Xia et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib34)\), Dr\. Zero\([Yue et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib41)\), and SCOPE\([Kwan et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib12)\)extend this paradigm to tool\-integrated reasoning, multi\-turn search, and document\-grounded task construction\. These methods demonstrate that data generation can be coupled with learner improvement rather than treated as a fixed preprocessing step\. Our work shares this closed\-loop perspective, but focuses on a different challenge: in interactive agentic environments, useful synthesis must not only generate harder examples, but also discover and control the interaction factors that determine feasibility, tool execution, state transitions, and downstream learning utility\.

### C\.2Feedback\-Driven Agentic Data Synthesis

Synthetic data for interactive agents introduces constraints that are less prominent in self\-contained reasoning tasks\. A generated example must correspond to a feasible environment state, admit an executable sequence of tool calls, satisfy domain policies, and lead to a verifiable outcome\. Recent environment\-grounded synthesis methods address these requirements by using exploration, trajectory reconstruction, or state replay to build executable agentic experience\. Explorer\([Pahuja et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib19)\)synthesizes diverse web trajectories through large\-scale environment exploration, OS\-Genesis\([Sun et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib24)\)derives executable GUI tasks from successful interactions, AutoPlay\([Ramrakhya et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib21)\)explores application states before producing grounded tasks, and Trajectory2Task\([Wang et al\., 2026b](https://arxiv.org/html/2610.12593#bib.bib32)\)converts valid tool trajectories into user\-facing tasks\. WebAggregator\([Wang et al\., 2026a](https://arxiv.org/html/2610.12593#bib.bib29)\)further constructs search tasks requiring compositional evidence aggregation\. These methods make important progress on feasibility and executability, but their feedback is primarily used to obtain valid instances or broaden trajectory coverage, rather than to revise an explicit synthesis control space according to the trained agent’s learning response\.

Other work improves the quality of tool\-use and multi\-turn synthetic data through checkers, validators, and data\-centric refinement\. EigenData\([Chen et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib2)\)synthesizes multi\-turn tool\-use dialogues with executable checkers, while APIGen and APIGen\-MT pipelines construct function\-calling or tool\-use supervision with varying degrees of automatic validation\. DreamGym\([Chen et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib3)\)scales synthetic tasks and interactions through a learned experience model\. These approaches show that agentic data generation benefits from structured procedures, executable verification, and iterative data\-quality control\. However, validation and repair mainly answer whether a generated sample is well formed, executable, or diverse\. They do not by themselves determine which interaction factors should receive more synthesis budget after training, or whether the current set of factors is sufficient to explain the remaining weaknesses of the task agent\.

Several recent frameworks further explore continual improvement in agentic settings\. CoEvolve\([Yang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib37)\)uses trajectory\-derived signals such as forgetting and uncertainty to guide subsequent tool\-use task synthesis, while Agent\-World\([Dong et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib6)\), SEAD\([Dai et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib5)\), AgentEvolver\([Zhai et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib43)\), EvolveR\([Wu et al\., 2025](https://arxiv.org/html/2610.12593#bib.bib33)\), and EvoFSM\([Zhang et al\., 2026](https://arxiv.org/html/2610.12593#bib.bib44)\)investigate the evolution of environments, curricula, workflows, memories, or interaction experiences across different agent tasks\. This literature establishes feedback\-driven agent improvement as a promising direction\. The remaining gap is how to translate feedback into reusable synthesis decisions\. In particular, existing methods often adapt by generating more valid instances, repairing failures, or upsampling weak categories, while leaving the underlying synthesis interface largely fixed\.EvoSyninstead treats the synthesis interface itself as an evolving object\. Its multi\-agent loop uses feedback not only to filter or repair samples, but also to support synthesis depth, which reallocates effort across known interaction factors, and synthesis breadth, which promotes previously implicit factors into explicit controls for future generation\.

## Appendix DRepresentative Agent Prompts

We provide representative prompt templates for the three agents that directly operate on the evolving synthesis state: the Designer, Planner, and Reflector\. The Designer and Reflector are domain\-agnostic, while domain\-specific tool schemas, policies, environment information, synthesis\-space values, and round\-specific feedback are injected at runtime\. We use Airline as the representative instantiation because it exposes the complete structured synthesis interface used in ourτ2\\tau^\{2\}\-Bench experiments\. For readability, we omit implementation\-only scaffolding while retaining the runtime inputs, decision rules, and output structure that determine each agent’s behavior\.

Designer PromptYou are the Designer for an interactive tool\-use task synthesizer\. You decide which synthesis directions the next batch should cover and how much generation budget each direction should receive\. You do not construct concrete tasks or instantiate specific entities\. A downstream Planner grounds your decisions into executable task blueprints\. RUNTIME INPUTS DOMAIN: airline DOMAIN CONTEXT SUMMARY: <environment and task context\> AVAILABLE TOOLS SUMMARY: <tool names, arguments, and functional descriptions\> POLICY SUMMARY: <domain policies and execution constraints\> CURRENT SYNTHESIS SPACE: \{ "task\_family": \[ "flight\_booking", "flight\_change", "flight\_cancellation", "refund\_or\_compensation", "seat\_or\_baggage\_service", "loyalty\_or\_membership\_service" \], "expected\_outcome": \["fulfill", "refuse"\], "policy\_or\_constraint\_focus": \[\.\.\.\], "tool\_use\_pattern": \[\.\.\.\], "interaction\_challenge": \[\.\.\.\], "difficulty\_profile": \["easy", "medium", "hard"\], <newly promoted factors, e\.g\., "num\_write": \["0", "1", "2", "3\-4", "5\+"\]\> \} STEERING SIGNAL: one of the following is provided at each round\. \(1\) NEWLY ADDED FACTOR: <new factor, admissible values, and currently under\-covered regions\> \(2\) LEARNER FEEDBACK: <coverage and post\-training task\-agent performance statistics\> \(3\) COLD\-START PRIOR: <initial exploration prior when no learner feedback is yet available\> INSTRUCTIONS For each synthesis direction: \-\- specify the capability or interaction structure to target; \-\- assign an objective type such as under\-covered, failure\-targeted, exploration, or repair; \-\- optionally specify preferred values as soft preferences; \-\- optionally specify allowed values as hard constraints; \-\- optionally specify forbidden values as hard exclusions; \-\- identify undesirable cross\-dimension patterns to avoid; \-\- assign a generation budget level; \-\- provide a concise rationale for why the direction is useful\. All referenced keys must belong to the current synthesis space\. A proposed direction should describe a capability or interaction structure, rather than a concrete action script on a particular entity\. Directions must remain realizable under the available tools, domain policy, and environment constraints\. When learner feedback is available, use performance and coverage signals to prioritize weak or under\-covered regions\. When a new synthesis factor has been introduced, deliberately allocate synthesis budget across its value range, particularly toward values that remain empty or under\-covered\. OUTPUT \{ "conditions": \[ \{ "condition\_id": "\.\.\.", "objective\_type": "undercovered \| over\_mastered \| failure\_targeted \| exploration \| repair", "objective": "\.\.\.", "preferred\_values": \{"<key\>": \["<value\>"\]\}, "allowed\_values": \{"<key\>": \["<value\>"\]\}, "forbidden\_values": \{"<key\>": \["<value\>"\]\}, "avoid\_patterns": \["\.\.\."\], "budget\_level": "zero \| low \| medium \| high \| explore", "rationale": "\.\.\." \} \] \} Output strict JSON only\.

Planner PromptYou are the Planner for interactive tool\-use task synthesis\. Given the current synthesis space and an optional generation direction from the Designer, construct one structured synthesis blueprint\. The blueprint defines a task type rather than a fully instantiated task\. A downstream Generator uses the blueprint together with the domain policy, tool schemas, and environment state to realize a concrete executable task\. RUNTIME INPUTS DOMAIN: airline DOMAIN CONTEXT SUMMARY: <environment and task context\> AVAILABLE TOOLS SUMMARY: <tool schemas and functional descriptions\> DATABASE / ENVIRONMENT SUMMARY: <available entities and environment state information\> POLICY SUMMARY: <domain policies and execution constraints\> DIMENSION VALUES: \{ "task\_family": \[ "flight\_booking", "flight\_change", "flight\_cancellation", "refund\_or\_compensation", "seat\_or\_baggage\_service", "loyalty\_or\_membership\_service" \], "expected\_outcome": \["fulfill", "refuse"\], "policy\_or\_constraint\_focus": \[\.\.\.\], "tool\_use\_pattern": \[\.\.\.\], "interaction\_challenge": \[\.\.\.\], "difficulty\_profile": \["easy", "medium", "hard"\], <additional evolved factors\> \} GENERATION CONDITION FROM DESIGNER: \{ "objective": "\.\.\.", "preferred\_values": \{\.\.\.\}, "allowed\_values": \{\.\.\.\}, "forbidden\_values": \{\.\.\.\}, "avoid\_patterns": \[\.\.\.\] \} INSTRUCTIONS Select mutually compatible values from the provided synthesis space: \-\- exactly one task\_family; \-\- exactly one expected\_outcome; \-\- one or two policy\_or\_constraint\_focus values; \-\- one to three tool\_use\_pattern values; \-\- zero to two interaction\_challenge values; \-\- exactly one difficulty\_profile; \-\- one value for each additional evolved factor when specified\. If a Designer condition is provided, obey all hard constraints and strongly prefer the specified soft preferences\. Complete the remaining dimensions so that the full selection is mutually compatible and realizable with the available tools and policy\. The blueprint should encourage genuine multi\-step interaction rather than surface\-level variation\. It should specify a task type rather than fixed entities or a memorized instance\. For policy\-compliant tasks, the intended trajectory should verify the relevant conditions and carry out the required state\-changing action\. For policy\-violating tasks, the intended trajectory should verify the violation and decline the request without an invalid state change\. OUTPUT \{ "domain": "airline", "plan\_id": "\.\.\.", "selected\_dimensions": \{ "task\_family": "\.\.\.", "expected\_outcome": "\.\.\.", "policy\_or\_constraint\_focus": \[\.\.\.\], "tool\_use\_pattern": \[\.\.\.\], "interaction\_challenge": \[\.\.\.\], "difficulty\_profile": "\.\.\.", <additional evolved factors\> \}, "generation\_intent": "\.\.\.", "success\_focus": \["\.\.\."\], "diversity\_notes": \["\.\.\."\], "expected\_difficulty\_controls": \{ "expected\_tool\_calls": "\.\.\.", "num\_policy\_constraints": "\.\.\.", "num\_entities": "\.\.\.", "requires\_clarification": true/false, "allows\_user\_false\_claim": true/false, "requires\_state\_change": true/false \} \} Output strict JSON only\.

Reflector PromptYou are the Reflector for a self\-evolving task\-synthesis pipeline\. You do not generate tasks or allocate synthesis budget\. Your role is to revise the synthesis space using post\-training learner feedback\. RUNTIME INPUT: SYNTHESIS AUDIT PACKAGE CURRENT SYNTHESIS SPACE: \{ "k\_1": \["v\_1", "v\_2", \.\.\.\], "k\_2": \[\.\.\.\], \.\.\. \} COVERAGE AND PERFORMANCE REPORT: \{ "<factor/value\>": \{ "coverage": "\.\.\.", "task\_agent\_performance": "\.\.\.", "before\_after\_training\_change": "\.\.\." \}, \.\.\. \} DIAGNOSTIC PROBE REPORT: \{ "<probe\>": \{ "distribution": "\.\.\.", "failure\_correlation": "\.\.\.", "coverage\_note": "\.\.\.", "suggested\_factor": \{ "name": "\.\.\.", "values": \[\.\.\.\] \} \}, \.\.\. \} EXPERIMENTAL FACTOR CARDS: <previously introduced factors and accumulated evidence\> PREVIOUS REFLECTOR OUTPUTS: <previous promotion / retention decisions\> INSTRUCTIONS Review the current synthesis space and determine whether the learner’s residual weaknesses are adequately represented by existing factors\. For previously introduced experimental factors, decide whether each should be promoted, retained for further evaluation, or deprecated\. A new synthesis factor may be justified in two ways: \(A\) FAILURE\-DRIVEN EXPANSION: A measurable interaction property occurs in the data and is systematically associated with learner failure\. This indicates a capability gap not adequately represented by the current synthesis space\. \(B\) COVERAGE\-GAP\-DRIVEN EXPANSION: A measurable interaction property exposes an important but severely under\-covered region\. Empty or nearly empty high\-value regions may indicate that the current synthesis process has not explored the corresponding interaction structure sufficiently\. When the per\-round factor budget forces a choice, prioritize failure\-driven evidence when a strong learner\-side signal is available\. Use coverage\-gap evidence to expose important regions that are systematically absent from the current synthetic experience\. Prefer factors supported by measurable diagnostic evidence over arbitrary semantic dimensions\. A new factor must be interpretable, low\-cardinality, non\-redundant with existing factors, and realizable by the downstream synthesis pipeline\. When a diagnostic probe provides a generator\-realizable suggested factor, prefer promoting that factor rather than inventing an unrelated coordinate\. Introduce at most one new synthesis factor in each round\. Do not rename, merge, delete, or change the semantics of existing seed or promoted factors\. OUTPUT \{ "round\_id": "\.\.\.", "synthesis\_space\_version\_in": "\.\.\.", "dimension\_reviews": \[ \{ "dimension": "\.\.\.", "decision": "promote \| keep\_experimental \| deprecate", "reason": "\.\.\.", "evidence": "\.\.\." \} \], "new\_proposals": \[ \{ "action": "no\_change \| promote\_probe\_to\_dimension \| add\_value", "dimension\_name": "\.\.\.", "values": \[\.\.\.\], "reason": "\.\.\.", "evidence": "\.\.\." \} \], "summary": "\.\.\." \} Output strict JSON only\.

The complete runtime prompts additionally include full machine\-readable schemas, round\-specific domain policies, tool specifications, environment summaries, and feedback statistics\. The representative templates above preserve the actual runtime inputs, constraints, and decision logic while omitting implementation\-only formatting and defensive scaffolding\.