DeltaHarness: Self-Evolving Harnesses for Resource-Adaptive Tool Execution
Summary
DeltaHarness 介绍了一种执行引导的策略搜索方法,通过 QHI 循环从冷启动测量中自演化工具执行 harness,以适应运行时资源条件;在视频编辑任务上将完整交付延迟降低 30.0%,并在留出任务上相比最优固定方案降低 8.2% 延迟。
View Cached Full Text
Cached at: 11/19/26, 03:33 AM
# DeltaHarness: Self-Evolving Harnesses for Resource-Adaptive Tool Execution
Source: [https://arxiv.org/html/2611.21688](https://arxiv.org/html/2611.21688)
Lecheng YanJianze LinAffiliation:Beijing Normal UniversityXicheng HanAffiliation:Zhejiang UniversityXiantao XuAffiliation:Dmall Inc\.Wenxi LiAffiliation:East China Normal UniversityChenyang LyuAffiliation:Alibaba Group
###### Abstract
Tool\-using agents rely on execution harnesses to organize and schedule tool operations\. The same task and resource description can conceal runtime conditions that reverse the latency ordering of valid execution plans\. Resolving this uncertainty requires firsthand execution in the target setting\. We introduce DeltaHarness, an execution\-guided policy\-search method that adapts agent harnesses from cold\-start measurements\. Its QHI loop uses the observed response to update runtime dispatch, revise physical plans, and select experiments for later proposals\. An independent confirmation panel controls policy replacement\. With fixed dispatch, a revised materialization policy reduces complete\-delivery latency by 30\.0% on one video\-editing task across three fresh pairs\. On held\-out tasks, the evolved policies reduce latency by 8\.2% relative to the best fixed plan in one seed and by 4\.6% relative to the initial proposal in another\.
## 1Introduction
Tool\-using language models execute tasks through harnesses that organize tool operations and control their execution\([Lyu et al\., 2024](https://arxiv.org/html/2611.21688#bib.bib29);[Wu et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib4);[Jiang et al\., 2026a](https://arxiv.org/html/2611.21688#bib.bib5)\)\. Resource\-aware execution exposes choices in dataflow structure, input access, and scheduling\([Poms et al\., 2018](https://arxiv.org/html/2611.21688#bib.bib1);[Chaudhry et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib2)\)\. A video composition can run as one fused render, as parallel output ranges, or through materialized clips\([Yan et al\., 2026b](https://arxiv.org/html/2611.21688#bib.bib30);[Yan et al\., 2026a](https://arxiv.org/html/2611.21688#bib.bib31)\)\. Parallel ranges can repeat decoding and add intermediate traffic\. Materializing clips spends local compute to change later input access\. Source layout, cache state, and interference determine which plan delivers fastest, even across executions with the same visible task and hardware description\.*When hidden runtime conditions can reverse plan ordering, identifying the faster plan requires firsthand execution in the target setting\.*
Execution\-guided search uses measured performance to revise systems algorithms\([Cheng et al\., 2025](https://arxiv.org/html/2611.21688#bib.bib3);[Hamadanian et al\., 2025](https://arxiv.org/html/2611.21688#bib.bib9)\), storage configurations\([Egersdoerfer et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib10)\), and serving policies\([Jiang et al\., 2026b](https://arxiv.org/html/2611.21688#bib.bib11)\)\. Prior programs and measurements provide an initial cost estimate; the target setting’s physical response updates it\. Under a fixed measurement budget, adaptation must also choose which comparisons will inform the next revision\.
Experiment selection connects harness evolution to task\-aware exploration, which values information by its effect on downstream control\([Wagenmaker et al\., 2023](https://arxiv.org/html/2611.21688#bib.bib8)\)\. Active video investigation tests competing failure explanations before harness revision\([Luo et al\., 2026a](https://arxiv.org/html/2611.21688#bib.bib17)\), while self\-improving branches adapt the development cases used for search\([Dong et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib16)\)\. We study whether selecting task–resource measurements can improve a successor’s physical execution policy\.
DeltaHarness extends this execution\-guided loop to physical tool plans with fixed model weights and tool kernels\. For a new device, workload, or resource setting, cold start combines inherited programs and experience with measurements of its current physical response\. The physical policyHHchooses partitioning, concurrency, fusion, and materialization\. The dispatcherQQuses measured delivery times to update admission decisions, andIIselects task–resource comparisons for the next proposal\. An independent common panel determines incumbent replacement\. Figure[1](https://arxiv.org/html/2611.21688#S2.F1)shows how experience in the target setting informs these revisions\.
Program\-level recursive self\-improvement also makes the improver itself an optimization target\([Srikanth et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib7)\)\. Our recursive variant rewrites its evidence\-analysis program, while policy self\-evolution updatesHH\. We compare learned experiment allocation with uniform and balanced panels under matched budgets, followed by frozen held\-out evaluation to assess transfer\([Wang et al\., 2026b](https://arxiv.org/html/2611.21688#bib.bib27);[Xia et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib6)\)\.
In the fixed\-dispatch video\-editing case, materializing clips before fusion reduces latency by 30\.0% and raises average active FFmpeg cores from 0\.95 to 1\.80\. On held\-out tasks, the first policy\-search seed beats the best fixed plan and the second improves its initial proposal\. Additional comparisons examine experiment selection, resource response, and orchestration\.
## 2Related Work
#### Measured Optimization of Computer Systems
Scanner exposes compressed\-video access and dataflow execution\([Poms et al\., 2018](https://arxiv.org/html/2611.21688#bib.bib1)\), while Murakkab combines workflow profiling with adaptive model and hardware configuration\([Chaudhry et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib2)\)\. LLM\-driven systems design builds on measured feedback: ADRS evolves performance\-oriented algorithms\([Cheng et al\., 2025](https://arxiv.org/html/2611.21688#bib.bib3)\); Glia coordinates reasoning, experimentation, and analysis\([Hamadanian et al\., 2025](https://arxiv.org/html/2611.21688#bib.bib9)\); STELLAR reruns applications to tune file systems\([Egersdoerfer et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib10)\); AUTOPOIESIS evolves serving policies under runtime dynamics\([Jiang et al\., 2026b](https://arxiv.org/html/2611.21688#bib.bib11)\); and MaxKernel uses compiler and profiling feedback for TPU kernels\([Wang et al\., 2026a](https://arxiv.org/html/2611.21688#bib.bib26)\)\. DeltaHarness applies this measured\-optimization principle to physical tool plans, separating experiment allocation from incumbent confirmation\.
#### Learning and Evolving Agent Harnesses
HarnessDev evaluates runnable harness creation and evolution\([Wu et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib4)\); HarnessEvolve diagnoses failures through reference trajectories\([Jiang et al\., 2026a](https://arxiv.org/html/2611.21688#bib.bib5)\); and multi\-task self\-evolution uses the same frozen agent as solver and optimizer\([Xu, 2026](https://arxiv.org/html/2611.21688#bib.bib19)\)\. Specialized harnesses accumulate diagnosis experience in OpsHarness\([Huang et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib21)\), design feedback in AutoDesign\([Luo et al\., 2026b](https://arxiv.org/html/2611.21688#bib.bib22)\), and research strategies in ScholarEvolve\([Yang et al\., 2026a](https://arxiv.org/html/2611.21688#bib.bib20)\)\. Learned editors provide another route: Harness Learning trains a proposer from task feedback\([Zhang et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib15)\), Harness\-R1 trains an engineer through target\-agent reruns\([Shao et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib24)\), and Harness\-Zero distills harness\-induced behavior into solver weights\([Ye et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib25)\)\. Our formulation fixes the model weights and tool kernels while exposing physical policies and measurement locations to the improver\.
#### Active Evidence and Improving Exploration
Task\-aware experiment design links observation value to its effect on the eventual policy, as in nonlinear system identification for controller optimization\([Wagenmaker et al\., 2023](https://arxiv.org/html/2611.21688#bib.bib8)\)\. VideoHarness\-RSI evolves video\-context constructors\([Xu and Chen, 2026](https://arxiv.org/html/2611.21688#bib.bib12)\), and Video\-RSI actively revisits videos to test failure explanations\([Luo et al\., 2026a](https://arxiv.org/html/2611.21688#bib.bib17)\)\. Exploration also improves through historical replay in Dream\-RSI\([Zheng et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib13)\), self\-modification records in SelfSearch\([Yang et al\., 2026b](https://arxiv.org/html/2611.21688#bib.bib18)\), shared group experience\([Weng et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib23)\), and adaptive development subsets and proposal guidance\([Dong et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib16)\)\. AIDE2 evaluates rewritten research agents through downstream research performance\([Srikanth et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib7)\)\. DeltaHarness focuses on fresh candidate–incumbent task/resource pairs: selected measurements inform a successor, while a common panel controls replacement\.
#### Evaluation and Transfer
RRSI regularizes harness evolution against development\-set overfitting\([Xia et al\., 2026](https://arxiv.org/html/2611.21688#bib.bib6)\)\. Rethinking Harness Evaluation compares evolution with task\-level search under matched feedback and inference budgets\([Wang et al\., 2026b](https://arxiv.org/html/2611.21688#bib.bib27)\)\. AutoTuneBench studies how baseline choice, hardware variation, headroom, and infrastructure affect tuning measurements\([Chen, 2026](https://arxiv.org/html/2611.21688#bib.bib14)\)\. Controlled agent\-scaling experiments further connect architecture benefits to task structure and coordination overhead\([Kim et al\., 2025](https://arxiv.org/html/2611.21688#bib.bib28)\)\. These findings motivate our fresh paired measurements, frozen held\-out evaluation, and separate reporting of execution gains and policy\-acquisition cost\.
Figure 1:Firsthand harness adaptation\. \(a\) A tool interface admits plans with unknown relative cost\. \(b\)IIchooses paired trials\. \(c\) The model revisesHHfrom the resulting experience;QQdispatches the graph\. The illustrated revision materializes clips before local fusion\.
## 3Problem Formulation
A taskxxspecifies a logical composition and its delivery contract\. The visible resource descriptioneecontains quantities such as CPU eligibility or an input\-response limit; observationsoodescribe measured behavior in the current setting\. A harness policy constructs a physical tool graph
G=H\(x,e,o\),G=\(V,E\)\.G=H\(x,e,o\),\\qquad G=\(V,E\)\.\(1\)Nodes bind fixed tool operations to arguments and resource requests, and edges impose dependencies\. The dispatcherQQschedules ready operations\. The optimization target is complete\-delivery timeT\(Q,H,x,e\)T\(Q,H;x,e\), including observation, policy evaluation, compilation, tool execution, and output checks\. We writeT\(H,x,e\)T\(H;x,e\)when the dispatcher is fixed\.
#### Why firsthand evidence is necessary\.
Letzzdenote conditions unresolved byee, such as cache state or interference\. Two plansppandqqcan share the same visible description yet reverse their expected ordering:
𝔼\[T\(p\)−T\(q\)∣x,e,z1\]\\displaystyle\\mathbb\{E\}\[T\(p\)\-T\(q\)\\mid x,e,z\_\{1\}\]<0,\\displaystyle<0,\(2\)𝔼\[T\(p\)−T\(q\)∣x,e,z2\]\\displaystyle\\mathbb\{E\}\[T\(p\)\-T\(q\)\\mid x,e,z\_\{2\}\]\>0\.\\displaystyle\>0\.When both runtime states are compatible with the available prior,\(x,e\)\(x,e\)leaves the current plan ordering unidentified\. Cold\-start executions supply observationsooof the target setting\. These observations update the evidence used for subsequent dispatch, policy revision, and experiment selection\.
Let𝒟r\\mathcal\{D\}\_\{r\}be the information available before proposalrr,H0H\_\{0\}the common initial policy, andHr−1H\_\{r\-1\}the incumbent\. A fixed model improverMMproposes
\(H~r,A~r\)=M\(H0,Hr−1,𝒟r\),\(\\widetilde\{H\}\_\{r\},\\widetilde\{A\}\_\{r\}\)=M\(H\_\{0\},H\_\{r\-1\},\\mathcal\{D\}\_\{r\}\),\(3\)whereA~r\\widetilde\{A\}\_\{r\}names candidate–incumbent comparisons on development task–environment cells\. The measurement ruleIIdetermines which locations are executed\. We compare measurement rules through the final policy they produce under the same proposal and execution budgets\.
Policy acquisition has a one\-time costCimproveC\_\{\\mathrm\{improve\}\}\. Overnndeployed tasks, its time cost is
Cimprove\+∑j=1nT\(Q,H,xj,ej\)\.C\_\{\\mathrm\{improve\}\}\+\\sum\_\{j=1\}^\{n\}T\(Q,H;x\_\{j\},e\_\{j\}\)\.\(4\)Held\-out execution ratios assess the reusable policy; model calls, development measurements, failures, and waits determine the acquisition term\.
Figure 2:The update loop in Algorithm[1](https://arxiv.org/html/2611.21688#alg1)\. Selected trials supply feedback; common confirmation controls incumbent replacement\. Both panels use fresh randomized\-order pairs\. Frozen policies are evaluated on held\-out tasks and resources\.
## 4DeltaHarness
DeltaHarness performs black\-box policy optimization with adaptive experiment allocation\. In the full loop,HHconstructs the physical graph andQQdecides whether to admit a ready operation or wait for an active one to finish\. Successful workflows supply decision\-to\-delivery times for updatingQQ\. The improver proposes revisions toHHandIIfrom accumulated outcomes\. The physical\-policy and allocation experiments use fixed dispatch\.
### 4\.1Representing Physical Policies
A policy maps task and resource observations to a complete physical plan\. The Linux studies implement this map as sandboxed source programs\. The Mac adaptation case uses ordered typed rules with a complete default branch: conditions test task or environment features and define missing\-value behavior\. These are distinct policy interfaces over the same kinds of physical choices\. The compiler and tool kernels are fixed within each comparison\.
For video editing, the plan chooses range count, range concurrency, even or clip\-aware cuts, longest\-processing\-time ordering, hardware decoding, clip materialization, materialization concurrency, and audio/video insertion order \(Appendix[A](https://arxiv.org/html/2611.21688#A1)\)\. These choices change the physical work\. Materialization creates local inputs for a fused render \(Figure[1](https://arxiv.org/html/2611.21688#S2.F1)\(c\)\); scheduling controls when the resulting nodes execute\.
### 4\.2Obtaining Firsthand Measurements
Cold start acquires response measurements from the current setting and combines them with inherited evidence\. An observation includes elapsed time, tool CPU time, input service, work size, and delivery status\. Task preparation supplies observations and reusable artifacts, with its cost included in each method’s execution\. Additional plan comparisons provide evidence for later decisions\.
A comparison cellu=\(x,e\)u=\(x,e\)binds a candidate and incumbent to the same task and environment\. Each policy executes freshly, consecutively, in randomized order\. Even identical plans receive separate executions\. The resulting record contains the common task observation, both policies, both delivery outcomes, and both costs\. Remeasuring the incumbent controls for drift better than comparison with a stale timing\.
Admission limits constrain declared tool pools; FFmpeg retains natural internal threading\. Linux CPU\-affinity and FUSE\-response controls, and Mac admission and HTTP\-response controls, retain their respective resource semantics throughout evaluation\.
### 4\.3Selecting Evidence for the Next Revision
Algorithm[1](https://arxiv.org/html/2611.21688#alg1)describes policy evolution with fixed dispatch\. Selected trialsArA\_\{r\}inform later proposals\. ConfirmationCrC\_\{r\}determines whether the current candidate replaces the incumbent\. Both panels contribute to the accumulated experience in Figure[2](https://arxiv.org/html/2611.21688#S3.F2)\. The allocation experiment uses source policies\.
Algorithm 1Policy evolution with fixed dispatch1:Common policy
H0H\_\{0\}, prior
𝒟1\\mathcal\{D\}\_\{1\}, model
MM, measurement rule
II
2:Development domain
𝒰\\mathcal\{U\}, fixed panel budgets
brA,brCb^\{A\}\_\{r\},b^\{C\}\_\{r\}for
RRrounds
3:for
r=1,…,Rr=1,\\ldots,Rdo
4:
\(H~r,A~r\)←M\(H0,Hr−1,𝒟r\)\(\\widetilde\{H\}\_\{r\},\\widetilde\{A\}\_\{r\}\)\\leftarrow M\(H\_\{0\},H\_\{r\-1\},\\mathcal\{D\}\_\{r\}\)
5:Freeze candidate
H~r\\widetilde\{H\}\_\{r\}and locations
A~r\\widetilde\{A\}\_\{r\}
6:
Ar←I\(A~r,𝒟r,𝒰,brA\)A\_\{r\}\\leftarrow I\(\\widetilde\{A\}\_\{r\},\\mathcal\{D\}\_\{r\},\\mathcal\{U\},b^\{A\}\_\{r\}\)
7:Reveal common panel
CrC\_\{r\}of size
brCb^\{C\}\_\{r\}
8:
FrC←Pair\(H~r,Hr−1,Cr\)F^\{C\}\_\{r\}\\leftarrow\\textsc\{Pair\}\(\\widetilde\{H\}\_\{r\},H\_\{r\-1\},C\_\{r\}\)
9:
FrA←Pair\(H~r,Hr−1,Ar\)F^\{A\}\_\{r\}\\leftarrow\\textsc\{Pair\}\(\\widetilde\{H\}\_\{r\},H\_\{r\-1\},A\_\{r\}\)
10:
Hr←RetainOrReplace\(Hr−1,H~r,FrC\)H\_\{r\}\\leftarrow\\textsc\{RetainOrReplace\}\(H\_\{r\-1\},\\widetilde\{H\}\_\{r\},F^\{C\}\_\{r\}\)
11:
𝒟r\+1←𝒟r∪\{FrC,FrA,Hr\}\\mathcal\{D\}\_\{r\+1\}\\leftarrow\\mathcal\{D\}\_\{r\}\\cup\\\{F^\{C\}\_\{r\},F^\{A\}\_\{r\},H\_\{r\}\\\}
12:endfor
13:Freeze
HRH\_\{R\}for held\-out evaluation
#### Measurement allocation\.
In the allocation study, the three LLM arms share model, prompt structure, sampling settings, and proposal count\.Uniformsamples development cells without replacement within a panel\.Balanceduses a predefined balanced panel\.Selectedexecutes the model’s locations, including repeats\. Invalid locations receive uniform replacement\. The model packet omits arm labels\. A\(1\+1\)\(1\+1\)\-ES baseline mutates resource\-bin plan parameters under the same execution budget, without additional LLM calls\.
All arms begin from oneH0H\_\{0\}generated before iterative candidate–incumbent feedback\. They share the prior and pilot, then receive their own measurements\. Each subsequent input retains the initial policy, incumbent, previous candidates, queries, acceptance decisions, failures, and costs\. Pair records contain both outcomes and coordinates\.
#### Incumbent replacement\.
The common panel is revealed after candidate freezing\. For paired lossesℓrj′\\ell^\{\\prime\}\_\{rj\}andℓrj\\ell\_\{rj\}onCrC\_\{r\}, define
ρr=exp\(1\|Cr\|∑j∈Crlogℓrj′ℓrj\)\.\\rho\_\{r\}=\\exp\\left\(\\frac\{1\}\{\|C\_\{r\}\|\}\\sum\_\{j\\in C\_\{r\}\}\\log\\frac\{\\ell^\{\\prime\}\_\{rj\}\}\{\\ell\_\{rj\}\}\\right\)\.\(5\)The plan\-search and allocation studies use delivery time as loss for complete pairs and predefined penalties for failed deliveries\. Replacement requiresρr≤0\.995\\rho\_\{r\}\\leq 0\.995and a one\-sided 90% upper bound below 1 from 2,000 cell\-bootstrap replicates\. In Algorithm[1](https://arxiv.org/html/2611.21688#alg1), onlyCrC\_\{r\}enters this decision\. Every candidate receives its allocated measurements, including slower candidates\.
#### Feedback and cost\.
The eight\-round allocation study uses 24 confirmation and 24 selected pairs per round, totaling 768 executions per arm and 25 LLM proposals including the common initial proposal\. Each proposal receives outcomes from completed previous rounds\. The acquisition cost includes the final round’s measurements\.
After development, policies are frozen and evaluated once on new tasks and resource conditions\. The intended allocation comparisons areSelected/UniformandSelected/H0H\_\{0\}, with task\-clustered uncertainty and complete delivery\.
#### Recursive variant\.
Plan search evaluates candidate–incumbent pairs on the full 96\-cell development panel each round\. Its recursive variant changes the improver’sanalyze\(data\)program and method notes every two rounds\. That program summarizes observations for subsequent proposals\. Comparison with a policy\-only improver measures the additional recursive layer \(Appendix[A](https://arxiv.org/html/2611.21688#A1)\)\.
## 5Evaluation
We evaluate firsthand policy revision, held\-out policy search, recursive analysis rewriting, and experiment allocation under fixed dispatch\. Each matched comparison fixes the task, resource condition, and tool implementation\. Appendix[C](https://arxiv.org/html/2611.21688#A3)gives additional server execution, orchestration, and scheduling measurements\.
#### Firsthand adaptation case\.
One fixed 312\-frame task runs on a 12\-core Mac with stage\-pool cap four and shared HTTP input\-response shaping at 4 MiB/s\. The valid referenceHPH\_\{P\}uses four clip\-aware ranges with LPT ordering\. The configured model,gpt\-6\.1\-terra, receives accumulated execution history, compares three alternatives, and revises its policy\. Three fresh randomized\-order pairs evaluate the frozen revision under the same source bytes, compiler, and resource condition\. The predefined development budget allows up to three such rounds; this case finishes in the first round\.
#### Frozen\-policy transfer\.
We freeze the Mac policy and reference before evaluating eight predefined, previously unexecuted edit configurations drawn from known media\. Stage cap four crosses local input and shared HTTP response limits of 4 and 1\.5 MiB/s, with two fresh randomized\-order pairs per task and condition: 48 pairs and 96 executions\. The primary panel is 4 MiB/s\. The two policies choose the same physical plan on local input, providing a control for measurement variability\. Frame completeness, latency, video fidelity, and audio duration are reported separately\.
#### Plan evolution\.
The plan\-search study develops policies on six tasks and sixteen environments: CPU\-affinity sizes 2/4/8/16 crossed with local input or FUSE rates 16/4/2 MiB/s\. Eight held\-out tasks cross 24 environments, adding 8/3 MiB/s, for 192 cells per seed\. Qwen3\.8\-27B generates ten candidates for a*policy\-only improver*with a fixed analysis procedure or a*recursive improver*that also rewrites its analysis program and method notes\. Table\-based ES uses the same paired evaluator\. The first policy\-only proposal is retained for a secondary no\-feedback comparison\. Two seeds run under different observed CPU contention\.
#### Measurement selection\.
The Linux allocation study uses eight search and four development\-validation tasks over sixteen environments\.Uniform,Balanced,Selected, and ES each receive eight rounds with 24 confirmation and 24 selected pairs\. LLM arms share Qwen3\.8\-27B, temperature 0\.6, and a 16,000\-token generation limit\. Final evaluation uses sixteen new edit configurations over known media and 24 environments, including new 6/1\.5 MiB/s conditions\. This experiment uses source policies; it does not evaluate ES over the Mac typed\-rule interface\.
#### Fixed plans and inference\.
Range4, range8, K2p2, and fused form the fixed plan bank; K2p2 uses two ranges with pool two\. The bank oracle takes the fastest measured plan per cell\. Ratios below 1 favor the numerator\. Held\-out intervals use 10,000 task\-cluster bootstrap replicates, keeping a task’s environments together\. Delivery failures are counted separately from physical latency; predefined penalties are used only for search losses\. The two plan\-search seeds are analyzed within their respective host conditions\.
#### Resource and delivery checks\.
FFmpeg retains natural internal threading\. Affinity controls CPU eligibility, and admission controls declared pools, on shared hosts\. The executor checks output properties; full AV decoding follows timing\. The retained quality results and contention\-retry protocol are in Appendix[B](https://arxiv.org/html/2611.21688#A2)\. Quality coverage includes format, decodability, and selected source/output comparisons\.
## 6Results
### 6\.1Firsthand Revision Improves a Valid Plan
Firsthand comparisons identify clip materialization followed by local fusion as an effective alternative to the four\-range referenceHPH\_\{P\}under constrained input service\. The revised policy uses a materialization pool of four in this setting\. Table[1](https://arxiv.org/html/2611.21688#S6.T1)gives the fresh confirmation results, and Appendix[C](https://arxiv.org/html/2611.21688#A3)reports the three alternatives that informed the revision\.
Table 1:Three fresh paired confirmations on the fixed task\. Both policies deliver all 312 frames with audio;H/HPH/H\_\{P\}is the complete\-delivery latency ratio\.The updated policy wins all three pairs and reduces complete\-delivery latency by 30\.0%\. Average active FFmpeg cores, measured as tool CPU seconds divided by delivery time, rise from 0\.95 to 1\.80\. Cumulative FFmpeg CPU seconds increase by 32\.4%, while source\-response payload falls from 44\.7–46\.9 MB to 19\.9–20\.1 MB\. Materialization mobilizes local compute and approximately halves traffic on the constrained input path\.
### 6\.2Transfer, Correctness, and Video Fidelity
The frozen\-policy evaluation reveals both latency changes and execution failures \(Figure[3](https://arxiv.org/html/2611.21688#S6.F3)\)\. The materialization policy completes 48/48 executions; the reference completes 40/48\. Eight reference executions lose frames under input shaping, leaving the all\-task primary speed comparison undefined\. These incomplete outputs are recorded as execution failures\.
Figure 3:Frozen\-policy transfer: per\-configurationH/HPH/H\_\{P\}latency, geometric mean of two fresh pairs\. Values below one favorHH\. Crosses in the lower strip mark reference frame deficits, which leave the full\-panel speed ratio undefined\. AllHHoutputs complete\.Conditional on both outputs being complete, latency reductions range from 15\.7–37\.5% at 4 MiB/s and 39\.1–55\.3% at 1\.5 MiB/s\. Local input provides a same\-action control: per\-configuration ratios span 0\.914–1\.082, with an aggregate ratio of 1\.014 \[0\.979, 1\.044\]\. This spread shows the measurement variability with two pairs per configuration\.
Materialization adds intermediate re\-encoding\. On fully aligned shaped\-input pairs, SSIM is 0\.9843–0\.9956 and PSNR is 32\.8–46\.4 dB, so the latency reductions accompany a measurable fidelity loss\. Audio sample counts match in all pairs\. Appendix[B](https://arxiv.org/html/2611.21688#A2)gives the delivery and fidelity breakdown\.
### 6\.3Policy Evolution Across Two Seeds
The first plan\-search seed obtains an 8\.2% reduction relative to range4, the best fixed plan in that run, and a 6\.6% reduction on unseen input\-response conditions\. The evolved/initial ratio is 0\.996 \[0\.988, 1\.003\] \(Figure[4](https://arxiv.org/html/2611.21688#S6.F4)\)\. The evolved and initial policies close 73\.0% and 69\.0% of the logarithmic bank\-oracle gap\. The policies select fused execution at low input\-service rates and use task features to condition the physical plan\.
Figure 4:Within\-seed latency ratios and task\-clustered 95% intervals on eight held\-out tasks and 192 cells per seed\. Values below one favor the numerator\. Seed B has higher external CPU contention\. Recursive denotes analysis rewriting; initial denotes the first policy\-only proposal\.The second seed runs under higher external CPU occupancy, approximately 0\.69 versus 0\.01 on assigned cores\. Policy\-only iteration reduces latency relative to its initial proposal by 4\.6%, with ratio 0\.954 \[0\.933, 0\.976\]\. Figure[4](https://arxiv.org/html/2611.21688#S6.F4)and Table[4](https://arxiv.org/html/2611.21688#A2.T4)report the policy and analysis\-rewriting comparisons in both seeds\. Table[5](https://arxiv.org/html/2611.21688#A2.T5)gives all fixed\-plan references\.
### 6\.4Physical Response and Server Execution
Controlled CPU\-affinity measurements reveal different resource responses for the physical plans \(Figure[5](https://arxiv.org/html/2611.21688#S6.F5)\)\. Fused execution benefits from larger affinity sets beyond the point where staged execution largely flattens\. This plan\-dependent response motivates conditioning the harness on both task structure and available resources\.
Figure 5:Physical\-plan response to CPU affinity\. Each point averages six compositions, with one observation per composition, plan, and setting\. FFmpeg uses automatic threads under a 128 MiB/s logical read/write service\. Affinity\-set size specifies eligible CPUs on a shared host\.Additional within\-host comparisons cover servers equipped with A100, RTX 3090, and RTX 4090 GPUs\. A DAG\-aware rule shortens six\-task episodes relative to native concurrency\-three execution in five host/resource conditions \(Appendix[C](https://arxiv.org/html/2611.21688#A3)\)\. That appendix also separates a model\-call orchestration gain from native rendering time and reports a same\-program feedback comparison\.
### 6\.5Measurement Allocation
Table[2](https://arxiv.org/html/2611.21688#S6.T2)reports the final policies from uniform, balanced, and model\-selected measurement schedules on sixteen held\-out tasks and 384 cells\. Each schedule receives the same eight\-round proposal and measurement budget\. Appendix[B](https://arxiv.org/html/2611.21688#A2)gives proposal\-validity counts, successful\-feedback timing, fixed\-plan comparisons, and results by resource condition\.
Table 2:Final allocation\-study outcomes on 16 held\-out tasks and 384 cells, with task\-clustered intervals\. S denotes Selected\. All three learned policies complete the evaluation; the shared initial policy and ES fail on all 384 cells\.
## 7Discussion
Cold\-start measurements contribute through the execution choices they change\. In the adaptation case, firsthand comparisons lead the improver to materialize clips before fusion\. This reduces source traffic and exposes more local concurrency, lowering delivery latency as CPU utilization rises\. The transfer measurements also reveal the fidelity effects of intermediate re\-encoding\. The scheduling comparison quantifies the interaction between useful overlap and interference with active work\. These outcomes illustrate how observations from the target setting guide physical harness decisions\.
## 8Conclusion
DeltaHarness uses cold\-start measurements to learn how execution plans behave under the current task and resource conditions\. This information guides dispatch, physical\-policy revision, and further measurement\. With fixed dispatch and tool kernels, a model\-selected materialization plan reduces complete\-delivery latency by 30\.0% on one task\. Held\-out policy search beats the best fixed plan in one seed and improves its initial policy in another\.
## References
- Chaudhryet al\.\(2026\)G\. I\. Chaudhry, E\. Choukse, H\. Qiu, Í\. Goiri, R\. Fonseca, A\. Belay, and R\. BianchiniMurakkab: resource\-efficient agentic workflow orchestration in cloud platforms\.In20th USENIX Symposium on Operating Systems Design and Implementation,pp\. 567–587\.External Links:[Link](https://www.usenix.org/conference/osdi26/presentation/chaudhry)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p1.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px1.p1.1)\.
- Chen \(2026\)L\. ChenAutoTuneBench: trustworthy measurement for agent auto\-tuning of LLM serving engines\.External Links:2609\.18123,[Link](https://arxiv.org/abs/2609.18123v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px4.p1.1)\.
- Chenget al\.\(2025\)A\. Cheng, S\. Liu, M\. Pan, Z\. Li, B\. Wang, A\. Krentsel, T\. Xia, M\. Cemri, J\. Park, S\. Yang, J\. Chen, L\. Agrawal, A\. Desai, J\. Xing, K\. Sen, M\. Zaharia, and I\. StoicaBarbarians at the gate: how AI is upending systems research\.External Links:2510\.06189,[Link](https://arxiv.org/abs/2510.06189v3)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p2.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px1.p1.1)\.
- Donget al\.\(2026\)H\. Dong, Y\. Zhou, Z\. Lin, Y\. Wu, B\. Peng, M\. Wang, X\. Fan, L\. Zhang, and Z\. ZhaoMixture of self\-improving branches for agent harness optimization\.External Links:2609\.37834,[Link](https://arxiv.org/abs/2609.37834v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p3.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
- Egersdoerferet al\.\(2026\)C\. Egersdoerfer, P\. Carns, S\. Snyder, R\. Ross, and D\. DaiSTELLAR: storage tuning engine leveraging LLM autonomous reasoning for high performance parallel file systems\.External Links:2602\.23220,[Link](https://arxiv.org/abs/2602.23220v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p2.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px1.p1.1)\.
- Hamadanianet al\.\(2025\)P\. Hamadanian, P\. Karimi, A\. Nasr\-Esfahany, K\. Noorbakhsh, J\. Chandler, A\. ParandehGheibi, M\. Alizadeh, and H\. BalakrishnanGlia: a human\-inspired AI for automated systems design and optimization\.External Links:2510\.27176,[Link](https://arxiv.org/abs/2510.27176v5)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p2.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px1.p1.1)\.
- Huanget al\.\(2026\)H\. Huang, J\. Lyu, Z\. Jiang, J\. Liu, X\. He, T\. Zhang, W\. Xiang, and M\. LyuFrom general agents to RCA experts: a self\-evolving harness for root cause analysis\.External Links:2608\.25661,[Link](https://arxiv.org/abs/2608.25661v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Jianget al\.\(2026a\)W\. Jiang, M\. Chu, Y\. Tian, Q\. Zhang, H\. Yang, R\. Yang, Y\. Liu, T\. Lv, and F\. LiHarnessEvolve: learning from reference trajectories for reliable agent self\-evolution\.External Links:2609\.00829,[Link](https://arxiv.org/abs/2609.00829v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p1.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Jianget al\.\(2026b\)Y\. Jiang, R\. Yan, Y\. Peng, W\. Li, T\. Wang, F\. Fu, and B\. YuanAUTOPOIESIS: a self\-evolving system paradigm for LLM serving under runtime dynamics\.External Links:2604\.07144,[Link](https://arxiv.org/abs/2604.07144v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p2.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px1.p1.1)\.
- Kimet al\.\(2025\)Y\. Kim, K\. Gu, C\. Park, C\. Park, S\. Schmidgall, A\. A\. Heydari, Y\. Yan, Z\. Zhang, Y\. Zhuang, Y\. Liu, M\. Malhotra, P\. P\. Liang, H\. W\. Park, Y\. Yang, X\. Xu, Y\. Du, S\. Patel, T\. Althoff, D\. McDuff, and X\. LiuTowards a science of scaling agent systems\.External Links:2512\.08296,[Link](https://arxiv.org/abs/2512.08296v3)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px4.p1.1)\.
- Luoet al\.\(2026a\)B\. Luo, J\. Guo, and S\. LiVideo\-RSI: recursive self\-improvement of video understanding agents via harness evolution\.External Links:2609\.37950,[Link](https://arxiv.org/abs/2609.37950v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p3.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
- Luoet al\.\(2026b\)Y\. Luo, H\. Jiang, J\. Zou, X\. Huang, W\. Yan, H\. Li, Z\. Yue, J\. Li, X\. Chen, X\. Zhao, J\. Liu, J\. Cui, Z\. Shen, and X\. LiAutoDesign: meta\-harness optimization for long\-horizon agentic design\.External Links:2608\.13560,[Link](https://arxiv.org/abs/2608.13560v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Lyuet al\.\(2024\)C\. Lyu, L\. Yan, R\. Xing, W\. Li, Y\. Samih, T\. Ji, and L\. WangLarge language models as code executors: an exploratory study\.External Links:2410\.06667,[Link](https://arxiv.org/abs/2410.06667)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p1.1)\.
- Pomset al\.\(2018\)A\. Poms, W\. Crichton, P\. Hanrahan, and K\. FatahalianScanner: efficient video analysis at scale\.ACM Transactions on Graphics37\(4\),pp\. 138:1–138:14\.External Links:[Document](https://dx.doi.org/10.1145/3197517.3201394),[Link](https://arxiv.org/abs/1805.07339)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p1.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px1.p1.1)\.
- Shaoet al\.\(2026\)S\. Shao, K\. Zhang, Q\. Li, S\. Wang, H\. Wang, W\. Jiao, Y\. Lu, Y\. Guo, W\. Liu, and W\. ZhangHarness\-R1: learning to edit executable runtime harnesses from agent failure trajectories\.External Links:2608\.02276,[Link](https://arxiv.org/abs/2608.02276v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Srikanthet al\.\(2026\)D\. Srikanth, B\. Zhao, D\. Xu, Y\. Wu, and Z\. JiangRecursive self\-improvement of AI research agents\.External Links:2609\.26457,[Link](https://arxiv.org/abs/2609.26457v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p5.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
- Wagenmakeret al\.\(2023\)A\. Wagenmaker, G\. Shi, and K\. JamiesonOptimal exploration for model\-based RL in nonlinear systems\.External Links:2306\.09210,[Link](https://arxiv.org/abs/2306.09210v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p3.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
- Wanget al\.\(2026a\)S\. Wang, N\. Cai, C\. Hong, J\. Walker, G\. Kroiz, G\. Vanica, D\. Patil, A\. Gavrilescu, H\. Sipra, and S\. SankaranMaxKernel: agentic kernel generation for TPUs\.External Links:2609\.04523,[Link](https://arxiv.org/abs/2609.04523v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px1.p1.1)\.
- Wanget al\.\(2026b\)Y\. Wang, H\. Zhu, Z\. Hu, Y\. Yuan, Z\. Chen, S\. Senthil, H\. Hajishirzi, Y\. Tsvetkov, P\. Dasigi, and T\. XiaoRethinking the evaluation of harness evolution for agents\.External Links:2607\.12227,[Link](https://arxiv.org/abs/2607.12227v2)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p5.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px4.p1.1)\.
- Wenget al\.\(2026\)Z\. Weng, A\. Antoniades, D\. Nathani, Z\. Zhang, X\. Pu, and X\. E\. WangGroup\-evolving agents: open\-ended self\-improvement via experience sharing\.InConference on Language Modeling,Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
- Wuet al\.\(2026\)Y\. Wu, J\. Zhang, J\. Shi, X\. Lei, Q\. Gu, Y\. Zhang, Z\. Wang, C\. He, C\. Huang, M\. Song, Z\. Zeng, S\. Wang, J\. Liu, Y\. Shi, J\. Liu, S\. Yan, W\. Huang, G\. Zhang, and W\. ZhangHarnessDev: can LLMs create and evolve their own agent harness?\.External Links:2609\.01437,[Link](https://arxiv.org/abs/2609.01437v1)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p1.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Xiaet al\.\(2026\)P\. Xia, R\. Han, Z\. Wang, Y\. Chen, Y\. Zhuang, Y\. Lee, C\. Huang, H\. Yu, Z\. CuiZhu, Y\. Ming, H\. Yao, B\. Gokturk, T\. Pfister, and C\. LeeRRSI: regularized recursive self\-improvement of agent harnesses\.External Links:2609\.24972,[Link](https://arxiv.org/abs/2609.24972v3)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p5.1),[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px4.p1.1)\.
- Xu and Chen \(2026\)G\. Xu and H\. ChenVideoHarness\-RSI: recursive harness self\-improvement for long\-video understanding with frozen vision\-language models\.External Links:2608\.24302,[Link](https://arxiv.org/abs/2608.24302v2)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
- Xu \(2026\)Q\. XuSelf\-evolving harness on multiple tasks with the agent as its own optimizer\.External Links:2609\.38372,[Link](https://arxiv.org/abs/2609.38372v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Yanet al\.\(2026a\)L\. Yan, J\. Lin, Y\. Zhang, B\. Pan, W\. Li, C\. Lyu, L\. Zhou, and C\. GurrinCrayotter: learning long\-horizon video editing agents via group\-relative preference backpropagation\.External Links:2608\.02694,[Link](https://arxiv.org/abs/2608.02694)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p1.1)\.
- Yanet al\.\(2026b\)L\. Yan, Y\. Zhang, X\. Xu, J\. Lin, B\. Pan, X\. Zheng, J\. Qian, A\. Wu, J\. Geng, R\. Li, F\. Cai, J\. Niu, R\. Li, W\. Li, and C\. LyuCrayotter: traceable multi\-agent workflows for long\-form video editing\.External Links:2606\.07636,[Link](https://arxiv.org/abs/2606.07636)Cited by:[§1](https://arxiv.org/html/2611.21688#S1.p1.1)\.
- Yanget al\.\(2026a\)J\. Yang, K\. Lai, X\. Wang, Y\. Harari, E\. Gabrilovich, and S\. ChangLearning from research: toward lifelong agent harness evolution\.External Links:2609\.40169,[Link](https://arxiv.org/abs/2609.40169v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Yanget al\.\(2026b\)J\. Yang, I\. Kong, and Y\. JoSelfSearch: reward\-free search for self\-improving agents\.External Links:2609\.37968,[Link](https://arxiv.org/abs/2609.37968v2)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
- Yeet al\.\(2026\)H\. Ye, Y\. Lu, H\. Dong, Z\. Su, and G\. SongHarness\-Zero: harness distillation via agent\-as\-harness\.External Links:2609\.24974,[Link](https://arxiv.org/abs/2609.24974v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Zhanget al\.\(2026\)A\. Zhang, X\. Liu, Z\. Wang, F\. Tajwar, D\. Arora, R\. Salakhutdinov, D\. Khashabi, Y\. Song, and A\. ZanetteHarness learning enables generalizable test\-time adaptation\.External Links:2609\.35738,[Link](https://arxiv.org/abs/2609.35738v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px2.p1.1)\.
- Zhenget al\.\(2026\)T\. Zheng, X\. Wu, Z\. Zhang, Z\. He, C\. Zhang, B\. Coleman, R\. Wei, D\. Bai, H\. Liu, R\. Liu, X\. Wang, Y\. Zhuan, W\. Kang, R\. Xiang, H\. Huang, X\. Cheng, and Y\. GuoDream\-RSI: recursive self\-improvement through evolving worlds\.External Links:2609\.14858,[Link](https://arxiv.org/abs/2609.14858v1)Cited by:[§2](https://arxiv.org/html/2611.21688#S2.SS0.SSS0.Px3.p1.1)\.
## Appendix APolicy Interfaces and Recursive Variant
#### Physical policy interface\.
The Mac policy evaluates ordered conditions, assigns missing\-value behavior, and ends with a complete default plan\. Task features include source intervals, clip count, output frames, transitions, and estimated decode work\. The Linux studies use sandboxed source policies\. Table[3](https://arxiv.org/html/2611.21688#A1.T3)lists the physical choices exposed by the executor; each comparison fixes its compiler and tool implementation\.
Table 3:Typed physical policy parameters\. CPU\-only experiments fix hardware decoding off\.
#### Recursive analysis rewriting\.
The policy\-only improver has a fixed method description and analysis procedure\. The recursive improver rewrites both its method description and a sandboxedanalyze\(data\)function every two rounds\. This function reads the arm’s accumulated task features, resource observations, plan parameters, wall times, tool CPU times, and I/O counts\. Its output enters later policy prompts\. Ifara\_\{r\}is that analysis program, the additional update is
ar\+1\\displaystyle a\_\{r\+1\}=ℛ\(ar,𝒟r\),\\displaystyle=\\mathcal\{R\}\(a\_\{r\},\\mathcal\{D\}\_\{r\}\),\(6\)H~r\+1\\displaystyle\\widetilde\{H\}\_\{r\+1\}=M\(Hr,𝒟r,ar\+1\(𝒟r\)\)\.\\displaystyle=M\(H\_\{r\},\\mathcal\{D\}\_\{r\},a\_\{r\+1\}\(\\mathcal\{D\}\_\{r\}\)\)\.Model weights and the experiment\-selection procedure remain fixed in this analysis\-rewriting comparison\. Rewriting the experiment\-selection programIIwould constitute another recursive layer\.
## Appendix BEvaluation Details
#### Two\-seed plan search\.
The policy\-only and recursive arms share Qwen3\.8\-27B, the paired evaluator, and a 32,000\-token generation limit\. If generation exhausts its budget before returning code, a direct\-answer continuation is used; 32 of 56 first\-seed calls use this rule\. Both arms make ten candidate proposals\. The no\-feedback comparator is the first policy\-only proposal\. Table[4](https://arxiv.org/html/2611.21688#A2.T4)gives the three LLM policies, and Table[5](https://arxiv.org/html/2611.21688#A2.T5)gives the fixed\-plan references\. Recursive/policy\-only ratios are 1\.012 \[0\.994, 1\.032\] in seed A and 0\.990 \[0\.975, 1\.011\] in seed B\. ES has overall ratio 1\.006 \[1\.003, 1\.009\] in seed A and point estimate 1\.004 in seed B\. Its unseen\-condition ratios are 1\.012 and 1\.003\. Output checks include format validation and sampled SSIM\.
Table 4:Plan\-search latency relative to range4, eight held\-out tasks and 192 cells per seed\. Unseen input\-response conditions are 8 and 3 MiB/s\. Intervals are task\-clustered\. External CPU occupancy differs between seeds\.Table 5:Fixed\-plan point estimates and per\-cell bank oracle relative to range4\. The best fixed plan changes from range4 to range8\.
#### Allocation\-study validity\.
Eight search tasks and four development\-validation tasks are selected before execution\. Final evaluation uses sixteen new complete edit configurations; a separate 32\-cell development\-validation diagnostic receives no later model feedback\. The shared 64\-cell pilot has best\-fixed geometric mean 32\.83 s and bank\-oracle mean 27\.33 s, a 16\.7% gap\. Every arm receives the complete pilot\. A descriptive best\-plan\-per\-environment combination closes 91\.8% of the logarithmic pilot gap\.
The common initial source violates its execution contract and is used without a successful initial\-policy confirmation\. ES mutations inherit the invalid source; several LLM proposals also fail the response contract\. Successful development executions are Uniform 624/768, Balanced 336/768, Selected 48/768, and ES 0/768\. Of Selected’s 192 requested locations, 120 are model choices and 72 use uniform replacement\. Its successful executions follow proposal eight\. Uniform, Balanced, and Selected complete all 384 final cells;H0H\_\{0\}and ES fail on all 384\. Their latency ratios to range4 are 1\.292 for Uniform, 1\.084 for Balanced, and 1\.272 for Selected\. The Selected/H0H\_\{0\}ratio of 0\.636 \[0\.590, 0\.686\] is a failure\-penalty statistic\. Selected’s logarithmic bank\-oracle gap closure is−120\.8%\-120\.8\\%\[−161\.7%\-161\.7\\%,−89\.8%\-89\.8\\%\]\. Table[6](https://arxiv.org/html/2611.21688#A2.T6)retains the resource\-level outcomes\.
Table 6:Measurement\-selection results by response condition, 64 cells per row\. S denotes Selected\. Its largest losses to Balanced occur at 6 and 4 MiB/s\.
#### Mac local\-I/O characterization\.
This pilot usesdeepseek\-v4\.1\-flash, distinct from the model in the Mac adaptation case\. Four tasks cross stage caps 1/2/4/8\. Fixed\-plan geometric means are 4\.60 s for range4, 5\.02 s for range8, 4\.73 s for K2p2, and 6\.15 s for fused; the oracle is 4\.50 s\. The 2\.1% gap is below the predefined 5% study premise, so this pilot proceeds to no policy\-evolution or held\-out evaluation\.
The contention rule permits two extra whole\-block attempts above 10% interference\. It retains the first complete attempt with known low contention, or the third attempt with its flag\. Unknown contention remains flagged\. This produces 180 pilot executions and thirty successful workflow\-check executions; actual costs include all attempts\.
#### Transfer outcomes and fidelity\.
Tables[7](https://arxiv.org/html/2611.21688#A2.T7)and[8](https://arxiv.org/html/2611.21688#A2.T8)report every condition and configuration\. Each ratio uses two pairs with complete video on both sides\. Reference frame deficits occur on configurations 03, 04, and 06 under input shaping\. All local deliveries complete\.
Table 7:Complete frozen\-policy deliveries\. Each condition contains eight new configurations and two pairs per configuration\.Table 8:Per\-task frozenH/HPH/H\_\{P\}latency ratios\. EveryHHdelivery completes\. Fail denotes a reference frame deficit in both repetitions, leaving the speed ratio undefined\.All 96 outputs decode without decoder errors\. Frame counts confirm 48 completeHHoutputs and 40 completeHPH\_\{P\}outputs; paired audio sample counts match throughout\. Of the 40 complete video pairs, 32 have full\-length SSIM/PSNR records; eight metric records end one frame before the decoded output\. Table[9](https://arxiv.org/html/2611.21688#A2.T9)reports the fully aligned subset\. The resulting fidelity loss reflects intermediate re\-encoding\.
Table 9:Video fidelity relative toHPH\_\{P\}on fully frame\-aligned transfer pairs\. Eight pairs have reference frame deficits; eight additional complete\-output pairs have a one\-frame\-short metric record\. Intermediate re\-encoding produces measurable image distortion\.
## Appendix CAdditional Execution Studies
#### Server execution\.
Table[10](https://arxiv.org/html/2611.21688#A3.T10)compares two fixed methods on three server stacks\. Native admits ready tool operations through a concurrency\-three pool; DAG rule is a graph\-dependent physical\-plan selector using the revealed dependencies\. Five paired blocks contain six\-task episodes under each resource sequence\. The machine\-readable supplement retains the original eight\-policy comparison; the table here addresses the defined native\-versus\-DAG comparison\.
Table 10:Server execution comparison: mean seconds per six\-task episode, five paired blocks per condition\. Native uses a concurrency\-three pool; DAG rule is a fixed graph\-dependent plan selector\. Accelerator names identify hosts\. Episode times include execution and diagnostics\.
#### Controlled CPU response\.
Figure[5](https://arxiv.org/html/2611.21688#S6.F5)covers six compositions at ten CPU\-affinity sizes: 120 executions, one observation per case, plan, and setting, in fixed pair order\. Every execution completes\. A private 128 MiB/s logical read/write service applies to each unit while host resources remain shared\. The curves plot workflow time, with setup and diagnostics accounted for separately\.
#### Model\-authored orchestration\.
A render\-first harness executes a known composition without routine model round trips\. Four development cases match two CPU\-affinity settings and two forced physical plans \(Table[11](https://arxiv.org/html/2611.21688#A3.T11)\)\. Worker time falls by 29\.8%, with 118\.0 s of normal generation calls removed\. Native rendering time is 275\.73 s before and 277\.53 s after the change\. This gain concerns the model\-call path\. Revised outputs satisfy the reported twelve\-second, 1080p, 30\-fps, audio\-present checks and decode successfully\.
Table 11:Model\-authored render\-first orchestration on four matched development cases\. Each pair uses the same forced physical plan\. Original and revised runs are temporally separated\.
#### Feedback changes plan selection\.
Whole\-plan observations update a selector that can choose Direct or parallel execution\. With the same revised source, feedback changes the twelve\-clip landscape plan to Direct and leaves the mixed\-orientation task unchanged \(Table[12](https://arxiv.org/html/2611.21688#A3.T12)\)\. Across eight suffix pairs, worker time falls from 227\.85 s to 186\.70 s, a reduction of 18\.1%\. A subsequent eight\-suffix control measures 178\.14 s for fixed Direct and 179\.23 s for feedback\. Thus, feedback recovers an effective existing choice; it does not outperform that stronger fixed control\. Output checks also identify audio residuals and mixed\-orientation geometry errors\.
Table 12:Mean suffix worker time with the same revised source, two ordered repetitions per cell on one learning trajectory\. Both compositions request 24 seconds\. Feedback changes the landscape plan and preserves the mixed\-task plan\.
#### Scheduling and overlap\.
Eight independent wait/admit pairs start from a common prediction state and use the same subsequent FIFO rule\. Admit completes the stream sooner in all pairs, with mean saving 0\.9%, and brings completion of the queued task forward by 5\.09 s\. The running task’s remainder increases by 40\.16 s\. This measures the trade\-off between useful overlap and active\-task contention\.
#### Comparisons preceding Mac confirmation\.
The model selects three alternatives on the fixed task: two ranges, three ranges, and materialization followed by fusion\. Their candidate/reference times are 15\.31/14\.21 s, 13\.98/14\.46 s, and 9\.75/14\.31 s\. All six outputs complete\. These observations enter the successor proposal before the separate confirmations in Section[6\.1](https://arxiv.org/html/2611.21688#S6.SS1)\.
## Appendix DDelivery\-Recovery Diagnostic
A delivery\-recovery comparison precedes the performance case\. The initial fusedH0H\_\{0\}produces 240/252/216 of the required 312 frames;HPH\_\{P\}completes\. A feedback successor retains the failing action\. Three fresh blocks with the initial policy and an additional\-call no\-feedback control give nine further failed outputs\.
Both branches then receive the same clarified complete\-delivery objective\. One call receives the execution outcomes; the matched call omits those outcomes\. The resultingH2H\_\{2\}chooses four clip\-aware ranges with LPT and completes, while the no\-feedback control remains incomplete \(Table[13](https://arxiv.org/html/2611.21688#A4.T13)\)\.H2H\_\{2\}has the reference’s physical action and ratio 1\.020\. This comparison measures recovery of output validity\. The performance case subsequently compares different complete\-delivery plans\.
Table 13:Recovery on three repetitions of one task\.H2H\_\{2\}restores delivery but uses the reference’s physical action and has no speed advantage\.
## Appendix EDevelopment Cost
The Mac performance case uses two model calls, 553,255 tokens, and six paired experiments, including the three fresh confirmations\. API call time totals 64\.8 s\. Incremental end\-to\-end study time is 11\.6 minutes, including artifact transfer; post\-timing output decoding takes 19\.6 s\. The Linux allocation experiment uses 25 generations and 1,561,455 generation tokens\. Its experimental runtime is 11\.8 hours, including failed setup, followed by 1\.8 hours of output decoding\. These are study costs; inherited experience acquisition and monetary costs remain incomplete\.
EXPERIMENT\_SUMMARY\.json, included with the paper’s source package, records the reported metrics, model identifiers, fixed\-plan comparisons, failures, and known cost components\. It retains unsuccessful setup, model waiting/loading, and infrastructure costs with their overlap relations\.Similar Articles
HarnessPro: Recursive Harness Self-Improvement with Pareto Optimization for Performance-Cost Trade-offs
HarnessPro 提出一种无标签的递归自改进方法,通过轨迹诊断与加权 Pareto 选择生成 lite/medium/heavy 三档 harness,在 Terminal-Bench 2、SWE-Bench Pro 等基准上相比 RHO 平均提升 2.0 个百分点通过率并降低 26.1% 单任务成本。
Harness-Delta Attribution: Dissecting Gains From Harness Evolution
提出了Harness-Delta Attribution(HDA)评估协议,将agent harness演化带来的性能增益分解为过拟合、测试时计算扩展和可泛化改进三部分,发现11个executor模型和3个框架中过拟合与测试时扩展平均解释了54%和14%的增益,搜索集收益往往无法迁移到held-out任务。
Self-Evolving Harness on Multiple Tasks with the Agent as Its Own Optimizer
提出一种自进化 agent harness 框架:同一冻结模型先作为 solver 解题、再作为 proposer 直接编辑自己的 harness 代码,在多任务上进化后于分布外基准上显著超越 Codex(提升 12.64 分)并达成匹配表现。
@snwiki238337: Current Harness optimization has two main directions. One is a unified global scaffold trying to use a single set of prompts and control logic. But as business scenarios grow, instructions optimized for financial spreadsheets often interfere with code generation tasks, causing severe rule conflicts and excessive context bloat. The other is to copy a separate specialized codebase for each specific domain...
Google Cloud AI Research, in collaboration with UIUC, proposes OO-Harness, which introduces object-oriented design (inheritance, encapsulation, polymorphism) into the automatic evolution of agent harnesses. Through a class hierarchy, it enables code reuse and safe fallback for specialized scaffolds. On three long-horizon benchmarks, the main metric improves from 61.62% to 77.41%, and it significantly outperforms traditional self-evolution methods on out-of-distribution tasks.
EMHO: EMbodied Agent Harness Optimization via Experience Traces
EMHO 提出一种自进化框架,在冻结具身模型的前提下,通过分析执行轨迹与历史经验自动迭代优化 agent harness(规划、上下文与工具使用),并在 EmbodiedBench 的导航与操作任务上一致提升 Qwen 9B/27B 的任务成功率。