DarwinX: Evolving Agent Harnesses Through Natural Selection
Summary
DarwinX evolves LLM agent harnesses via natural-selection-style population search with frozen model weights, improving verified performance across multiple benchmarks without benchmark-specific patching.
View Cached Full Text
Cached at: 08/14/26, 03:25 AM
Paper page - DarwinX: Evolving Agent Harnesses Through Natural Selection
Source: https://huggingface.co/papers/2608.07545 Authors:
,
,
,
,
,
,
,
,
,
,
Abstract
DarwinX evolves agent harnesses via population selection with frozen models, improving verified performance across benchmarks without benchmark-specific patches.
AnLLM agent’s capability depends not only on model weights but on itsharness: prompts, tools, skills, and control flow.Self-improvementloops already editharnesses, yet single-lineage search is path-dependent and local wins often regress other tasks. We introduceDarwinX, which treats self-evolution as selection over a population ofharnesses with the model frozen: apreserve-and-extend contractadmits only variants that extend coverage without regressing, anarchivekeeps alternative lineages forrecombination, and failure-, teacher-, and self-derived evidence share one edit interface. Fitness comes from each benchmark’s ownverifier: no gold solutions, no hand-picked winners. Across four benchmarks that progressively separate the evolution signal from the test, one loop adds about 17 points on average: Terminal-Bench 2.1 rises +7.7 to 83.2% on a matched base and to the verified frontier at 84.7% on a stronger one; TerminalWorld’s held-out split reaches 68.3%, ahead of every off-the-shelf agent; WebArena-Infinity real-task pass@1 rises from 43.5% to 93.0% audit-clean; and a Terminal-Bench 2.1harnesstransfers unchanged to SWE-bench Verified. What evolves is general agent competence, not benchmark-specific patches, so it survives changes of task,verifier, and base model. A frozen model need not be a fixed agent:harnessselection turns evaluation compute into durable capability.
View arXiv pageView PDFProject pageAdd to collection
Get this paper in your agent:
hf papers read 2608\.07545
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2608.07545 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2608.07545 in a dataset README.md to link it from this page.
Spaces citing this paper1
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Rethinking the Evaluation of Harness Evolution for Agents
This paper re-evaluates the methodology of automatic harness evolution for LLM agents, highlighting that its gains may stem from additional test-time search rather than improved harness design, and that evaluation on the same benchmark risks overfitting. Experiments show that harness evolution does not consistently outperform simpler test-time scaling methods.
HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry
HarnessX is a foundry for composable, adaptive, and evolvable AI agent harnesses that uses compositional primitives and trace-driven evolution to improve agent performance. Across five benchmarks, it achieves an average gain of +14.5% (up to +44.0%), demonstrating that runtime interface evolution is a complementary lever to model scaling.
EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents
Introduces EvoHarness-RL, a framework that learns runtime harness policies for long-horizon LLM agents, enabling them to construct and update external state (belief, progress, experience) during task execution. Using Qwen3-8B on ALFWorld, it achieves 96.9% success and reveals harness annealing and evolution dynamics.
Rethinking the Evaluation of Harness Evolution for Agents
This paper rethinks how automatic harness evolution for agents should be evaluated, showing that gains may be due to increased compute rather than genuine improvements, and that evolved harnesses transfer poorly to unseen tasks.
@NFTCPS: HarnessX is pretty interesting: an agent architecture that can modify itself. Previously, architectural changes relied entirely on manual tuning. When a new model came out, Anthropic removed the planning steps from Claude Code, and Manus refactored its agents five times in six months, each time simplifying. What to change and when to change it — all decided by humans.
HarnessX introduces a framework for self-evolving AI agent harnesses that treats the runtime harness as a first-class object, enabling automatic adaptation via trace-driven reinforcement learning. It achieves average gains of +14.5% across five benchmarks, with larger improvements for weaker models.