CurateEvo: Data-Curation Evolving for Agentic Post-Training

arXiv cs.CL Papers

Summary

CurateEvo is a failure-driven dynamic evolution framework for agentic post-training data curation. It iteratively rewrites curation strategies using failed trajectories, improving effectiveness and efficiency on benchmarks like ACEBench-Agent and BFCL-V4.

arXiv:2607.06140v1 Announce Type: new Abstract: Large language model (LLM) agents require post-training methods that can improve long-horizon decision making from environment feedback. However, existing agentic post-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures. We propose CurateEvo, a failure-driven dynamic evolution framework for agentic post-training data curation. CurateEvo represents the curation strategy as executable code and iteratively rewrites it using failed trajectories from a held-out development set. At each epoch, the evolved strategy transforms a fixed raw corpus into supervised fine-tuning data, reinforcement learning data, and an inference-time memory bank. The evolution process first improves effectiveness by diagnosing recurring failure modes and augmenting, filtering, or refining data accordingly, and then improves efficiency by pruning redundant or low-utility training turns under a cost-aware objective. Experiments on ACEBench-Agent, BFCL-V4, and {\tau}^2-Bench under both labeled and wild-data settings show that CurateEvo consistently outperforms prior curation methods, improving average scores by 3.2 and 2.7 points, respectively. Further analyses demonstrate that CurateEvo is compatible with different post-training recipes and substantially reduces curation overhead.
Original Article
View Cached Full Text

Cached at: 07/08/26, 04:42 AM

# CurateEvo: Data-Curation Evolving for Agentic Post-Training
Source: [https://arxiv.org/abs/2607.06140](https://arxiv.org/abs/2607.06140)
[View PDF](https://arxiv.org/pdf/2607.06140)

> Abstract:Large language model \(LLM\) agents require post\-training methods that can improve long\-horizon decision making from environment feedback\. However, existing agentic post\-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures\. We propose CurateEvo, a failure\-driven dynamic evolution framework for agentic post\-training data curation\. CurateEvo represents the curation strategy as executable code and iteratively rewrites it using failed trajectories from a held\-out development set\. At each epoch, the evolved strategy transforms a fixed raw corpus into supervised fine\-tuning data, reinforcement learning data, and an inference\-time memory bank\. The evolution process first improves effectiveness by diagnosing recurring failure modes and augmenting, filtering, or refining data accordingly, and then improves efficiency by pruning redundant or low\-utility training turns under a cost\-aware objective\. Experiments on ACEBench\-Agent, BFCL\-V4, and \{\\tau\}^2\-Bench under both labeled and wild\-data settings show that CurateEvo consistently outperforms prior curation methods, improving average scores by 3\.2 and 2\.7 points, respectively\. Further analyses demonstrate that CurateEvo is compatible with different post\-training recipes and substantially reduces curation overhead\.

## Submission history

From: Dingzirui Wang \[[view email](https://arxiv.org/show-email/88252332/2607.06140)\] **\[v1\]**Tue, 7 Jul 2026 11:07:00 UTC \(366 KB\)

Similar Articles

Can Generalist Agents Automate Data Curation?

arXiv cs.AI

Researchers introduce Curation-Bench, a benchmark to evaluate whether generalist coding agents can automate the iterative data curation loop in AI development. Results show agents can match strong baselines within ten iterations, but reliable data research requires scaffolded method adaptation rather than open-ended prompting alone.

Can Generalist Agents Automate Data Curation?

Hugging Face Daily Papers

This paper explores whether generalist coding agents (Claude Code, Codex, etc.) can automate data curation loops, achieving published baselines within 10 iterations but revealing a gap in exploring new methods. A scaffold that forces agents to adapt prior research yields policies that beat baselines using 10x less data.