CausalEvo:面向医疗健康大语言模型智能体的因果技能自我进化
摘要
CausalEvo:面向医疗健康大语言模型智能体的因果技能自进化提出了一种因果技能自进化方法,通过在固定模型权重和规则数量下对比不同技能集的效果来决定保留或替换技能,在 MedCalc-Bench-Verified 六项任务上达到 60.00% 准确率,优于 SkillOpt(55.83%),且训练词元消耗减少 55.6%。
查看缓存全文
缓存时间: 2026/10/16 06:56
# Causal Skill Self-Evolutionfor Health LLM Agents
Source: [https://arxiv.org/html/2610.21016](https://arxiv.org/html/2610.21016)
## CausalEvo: Causal Skill Self\-Evolution for Health LLM Agents
Yuchen ZhangAffiliation:The University of Texas Health Science Center at HoustonEmail:[yuchen\.zhang@uth\.tmc\.edu](mailto:)
###### Abstract
Large language model \(LLM\) agents for health can accumulate reusable textual skills from task feedback, such as calculation criteria, measurement time points, and formula units\. Deciding which skills to retain is consequential: useful rules improve later answers, while faulty generalizations propagate errors\. We propose CausalEvo, a method for causal skill self\-evolution that estimates the relative effects of deliberately changed skill sets while holding the model weights, feedback cases, and rule count fixed\. At each evolution step, a frozen LLM proposes candidate rules, which are pooled with the incumbent skills so that the current skill set remains a feasible choice\. Paired skill replacements against shared background rules are scored on the same feedback cases; least squares converts the score differences into relative skill values, and the top\-ranked rules are retained, favoring incumbents on ties\. A decision\-loss bound separates candidate support, approximation, and estimation errors\. On six MedCalc\-Bench\-Verified tasks with 120 held\-out cases, CausalEvo achieves 60\.00% accuracy, compared with 55\.83% for SkillOpt and 51\.67% without skills\. Across the recorded training configurations, which use different optimization budgets, it consumes 55\.6% fewer training tokens than SkillOpt\. Gains concentrate in particular calculations alongside regressions on others, and paired accuracy intervals include zero\. CausalEvo turns task feedback into controlled decisions about skill retention and replacement\. Project repository:[https://github\.com/txbrook/CausalEvo](https://github.com/txbrook/CausalEvo)\.
## 1Introduction
Health LLM agents with frozen weights can retain instructions distilled from feedback\. In medical calculation, these skills may specify a scoring criterion, a measurement time point, or a formula’s units\. A useful rule can improve later answers; an incorrect generalization can also persist across cases\. This makes the decision to retain or replace a skill part of agent reliability: what evidence should guide skill evolution?
External\-memory adaptation stores knowledge acquired from feedback\([Shinn et al\., 2023](https://arxiv.org/html/2610.21016#bib.bib14);[Wang et al\., 2024](https://arxiv.org/html/2610.21016#bib.bib15);[Zhang et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib20)\), and textual optimizers already combine proposals with evaluation\([Agrawal et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib1);[Lin et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib9);[Zhao et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib21)\)\. We focus on how changing the supplied skill set affects task performance\.
CausalEvo treats skill evolution as a causal comparison: on the same feedback case, we change the supplied rules while keeping the model weights and rule count fixed, and observed score differences estimate the relative effects of the compared skill sets\. We call this controlled change a skill intervention\. Our organizing principle is thatskill selection should use comparisons that preserve the deployed rule capacity\. A generator that rewrites every candidate may remove an old skill before retention can be evaluated, so the incumbent skill stays in the feasible set\. Comparisons that change the number of rules mix content effects with size effects, so compared skills have equal capacity\.
The frozen model proposes rules; a program collects paired exchanges on a comparison graph, estimates relative rule values, and selects the next skill \(Figure[1](https://arxiv.org/html/2610.21016#S1.F1)\)\. Proposal quality remains the model’s responsibility; credit estimation and selection are programmatic\.
Our contributions are \(i\) a formulation of skill evolution with incumbent\-containing feasible sets; \(ii\) a fixed\-capacity exchange estimator and decision\-loss decomposition, using classical statistical tools to analyze textual skills; and \(iii\) a 120\-case held\-out comparison with SkillOpt and no skill, learning dynamics, output\-validity diagnostics, and a credit\-assignment ablation\.
Figure 1:Overview of CausalEvo\. Incumbent skills \(St=MtS\_\{t\}=M\_\{t\}\) and model\-generated proposals form a candidate pool\. On a fixed feedback case, two skill sets sharek−1k\-1background rules and exchange one rule\. The frozen actor scores both skill sets; paired score differences fit relative skill values for top\-kkselection, with ties favoring incumbent rules\.
## 2Related work
#### Continual learning\.
Elastic Weight Consolidation protects parameters important to previous tasks\([Kirkpatrick et al\., 2017](https://arxiv.org/html/2610.21016#bib.bib6)\); Gradient Episodic Memory constrains updates using stored examples and distinguishes accuracy from backward and forward transfer\([Lopez\-Paz and Ranzato, 2017](https://arxiv.org/html/2610.21016#bib.bib11)\)\. External\-memory methods retain verbal reflections \(Reflexion\), executable skills \(Voyager\), or incrementally curated playbooks \(ACE\)\([Shinn et al\., 2023](https://arxiv.org/html/2610.21016#bib.bib14);[Wang et al\., 2024](https://arxiv.org/html/2610.21016#bib.bib15);[Zhang et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib20)\)\. CausalEvo studies retention with frozen parameters and a finite textual skill\. The incumbent remains a feasible decision, and we assess retention through task\-specific backward transfer\.
#### Textual optimization\.
Self\-Refine revises individual outputs through self\-feedback\([Madaan et al\., 2023](https://arxiv.org/html/2610.21016#bib.bib12)\); TextGrad propagates textual feedback through computation graphs\([Yuksekgonul et al\., 2025](https://arxiv.org/html/2610.21016#bib.bib19)\); GEPA tests reflected prompt changes and combines complementary candidates\([Agrawal et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib1)\)\. SkillOpt optimizes external skill documents through feedback and validation\([Yang et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib18)\)\. SkillBoost evaluates repairs under regression constraints\([Lin et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib9)\), while SkillCAT combines contrastive extraction, patch assessment, and skill topology\([Chen et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib2)\)\. CausalEvo shares proposal generation and empirical evaluation, focusing on comparisons among deployable skills in an incumbent\-containing, fixed\-capacity family\. We compare with adapted SkillOpt; broader end\-to\-end comparisons remain open\.
#### Composition\-aware valuation\.
SkillShapley attributes performance to skill steps using Shapley values and boundary\-adaptive sampling\([Liu et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib10)\)\. CASS combines paired coalition\-knockout margins with aggregate reward when accepting skill banks\([Zhao et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib21)\)\. Beta Shapley weights marginal contributions across coalition sizes, while Data Banzhaf studies robustness to noisy utility measurements\([Kwon and Zou, 2022](https://arxiv.org/html/2610.21016#bib.bib7);[Wang and Jia, 2023](https://arxiv.org/html/2610.21016#bib.bib16)\)\. CausalEvo compares equal\-capacity replacements to identify a first\-order value projection aligned with the deployment constraint\. Higher\-order interactions and finite\-sample errors can still impair selection\.
#### Causal skill curation\.
ASSAY uses randomized masking to estimate skill–task effects for library restructuring and task\-conditioned masking\([Wang et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib17)\)\. CaSKG calibrates skill relations through textual counterfactual probes for task\-conditioned retrieval\([Li et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib8)\)\. CausalEvo studies skill evolution in a persistent textual skill\. Its exchanges hold background rules fixed and estimate effects of skill replacement under a specified case and background distribution\. Least\-squares recovery from paired observations follows classical graph ranking\([Jiang et al\., 2011](https://arxiv.org/html/2610.21016#bib.bib3)\); we connect this estimator to constrained skill selection and its decision errors\.
#### Health agent benchmarks\.
MedCalc\-Bench and its Verified repository provide numerical medical\-calculation records and automatically scored feedback\([Khandekar et al\., 2024](https://arxiv.org/html/2610.21016#bib.bib5);[MedCalc\-Bench maintainers, 2026](https://arxiv.org/html/2610.21016#bib.bib13)\)\. This permits evaluation of skill evolution through accuracy, regressions, and task\-specific behavior\. MedAgentBench evaluates interaction with a virtual electronic health record and clinical APIs\([Jiang et al\., 2025](https://arxiv.org/html/2610.21016#bib.bib4)\)\. Our static calculation study addresses one component of health\-agent adaptation; interactive workflows and longitudinal validation remain open\.
## 3Problem formulation
#### Skill definition\.
A rule is a short, reusable instruction clause\. The agent’s skill is an ordered rendering of its selected rules\. A skill evolution step selects the next skill using externally supplied labeled feedback\.
Letfθf\_\{\\theta\}be a frozen language model,MtM\_\{t\}its current skill, andxxa task input with reference answeryy\. For a skillSS, let
Y\(x,S,ξ\)=r\(fθ\(x,render\(S\),ξ\),y\)∈\[0,1\],Vt\(S\)=𝔼x∼Pt,ξ\[Y\(x,S,ξ\)\]\.Y\(x,S,\\xi\)=r\\bigl\(f\_\{\\theta\}\(x,\\operatorname\{render\}\(S\);\\xi\),y\\bigr\)\\in\[0,1\],\\qquad V\_\{t\}\(S\)=\\mathbb\{E\}\_\{x\\sim P\_\{t\},\\xi\}\[Y\(x,S,\\xi\)\]\.\(1\)Hereξ\\xiincludes model and execution randomness; rendering fixes the order and formatting of rules\. The value function is conditional on a fixed execution configuration, including reasoning mode and decoding settings, whose notation we suppress\. The distributionPtP\_\{t\}specifies which health tasks matter at roundtt\. We analyze each evolution step under its current task distribution and execution configuration\.
Given a new labeled experienceete\_\{t\}, a proposal operator generates textGθ\(Mt,et\)G\_\{\\theta\}\(M\_\{t\},e\_\{t\}\)\. The controller constructs a candidate collectionDtD\_\{t\}and a feasible familyΩt\\Omega\_\{t\}, then choosesMt\+1∈ΩtM\_\{t\+1\}\\in\\Omega\_\{t\}\. The separation is substantive: the model determines what can be proposed, while the experimental controller determines what the available observations support selecting\.
### 3\.1Incumbent feasibility
Retention requires candidate support: keeping a previous rule requires that rule or an equivalent replacement to be available inDtD\_\{t\}\. To preserve the entire incumbent skill as a feasible choice, we impose
Mt∈Ωtfor every non\-initial round\.M\_\{t\}\\in\\Omega\_\{t\}\\quad\\text\{for every non\-initial round\}\.\(2\)For the prototype,\|Mt\|=k=4\|M\_\{t\}\|=k=4,GθG\_\{\\theta\}returns two new rules,Dt=Mt∪Gθ\(Mt,et\)D\_\{t\}=M\_\{t\}\\cup G\_\{\\theta\}\(M\_\{t\},e\_\{t\}\)hasn=6n=6distinct clauses, andΩt=\{S⊆Dt:\|S\|=k\}\\Omega\_\{t\}=\\\{S\\subseteq D\_\{t\}:\|S\|=k\\\}\. The first round generates six rules from an empty skill\. Invalid or textually duplicate proposals retain the current skill\.
### 3\.2Value projection
Condition on a fixed round, candidate collection, and value function, and suppresstt\. LetZ∈\{0,1\}nZ\\in\\\{0,1\\\}^\{n\}be the indicator of a uniformly chosen member ofΩk\\Omega\_\{k\}\. Define the best first\-order approximation
\(a∗,b∗\)=argmina,b:𝟏⊤b=0𝔼Z∼Unif\(Ωk\)\[V\(Z\)−a−b⊤Z\]2\.\(a^\{\*\},b^\{\*\}\)=\\arg\\min\_\{a,b:\\mathbf\{1\}^\{\\top\}b=0\}\\mathbb\{E\}\_\{Z\\sim\\operatorname\{Unif\}\(\\Omega\_\{k\}\)\}\\left\[V\(Z\)\-a\-b^\{\\top\}Z\\right\]^\{2\}\.\(3\)The zero\-sum condition resolves the intercept ambiguity on a fixed\-size slice\. The projection applies to arbitrary skill\-value functions, including those with interactions between rules\. Selecting the largestkkcoordinates optimizes the fitted first\-order surrogate; nonlinear complementarity can make that selection suboptimal forVV\.
Fori≠ji\\neq j, sample a backgroundBBuniformly from the\(k−1\)\(k\-1\)\-subsets excludingi,ji,j\. The two treatments areB∪\{i\}B\\cup\\\{i\\\}andB∪\{j\}B\\cup\\\{j\\\}\. They have equal rule counts and share all other rules\. Define
δij=𝔼B\[V\(B∪\{i\}\)−V\(B∪\{j\}\)\]\.\\delta\_\{ij\}=\\mathbb\{E\}\_\{B\}\\left\[V\(B\\cup\\\{i\\\}\)\-V\(B\\cup\\\{j\\\}\)\\right\]\.\(4\)
###### Proposition 1\(Fixed\-capacity exchange identity\)\.
For any real\-valuedVVonΩk\\Omega\_\{k\}, with1≤k<n1\\leq k<n, the projection in \([3](https://arxiv.org/html/2610.21016#S3.E3)\) satisfies
bi∗=n\(n−1\)k\(n−k\)Cov\(Zi,V\(Z\)\),δij=bi∗−bj∗\.b\_\{i\}^\{\*\}=\\frac\{n\(n\-1\)\}\{k\(n\-k\)\}\\operatorname\{Cov\}\(Z\_\{i\},V\(Z\)\),\\qquad\\delta\_\{ij\}=b\_\{i\}^\{\*\}\-b\_\{j\}^\{\*\}\.\(5\)
The result follows from the covariance matrix of fixed\-size sampling and is proved in Appendix[A](https://arxiv.org/html/2610.21016#A1)\. Equation \([5](https://arxiv.org/html/2610.21016#S3.E5)\) averages over eligible backgrounds; individual\-background contrasts can differ from this average\. Any componenth\(\|S\|\)h\(\|S\|\)depending only on rule count cancels exactly in these exchanges\. Token count, rule order, and meaning can still affect the measured contrast\.
## 4Method
### 4\.1Evidence collection on a comparison graph
Direct evaluation estimatesV\(S\)V\(S\)separately for each feasible skill: the prototype has\(64\)=15\\binom\{6\}\{4\}=15such sets\. CausalEvo collects paired exchanges from \([4](https://arxiv.org/html/2610.21016#S3.E4)\) to fitnnrelative rule values, then selectskkrules by their summed value\. The connected comparison graph places all rules on a common scale; the resulting first\-order representation supports selection across the feasible family\. For each directed edgee=\(i,j\)e=\(i,j\), we run the agent twice on the same feedback case with the two skills from \([4](https://arxiv.org/html/2610.21016#S3.E4)\)\. The measured difference is
de=Y\(xe,Be\+i,ξe\+\)−Y\(xe,Be\+j,ξe−\)\.d\_\{e\}=Y\(x\_\{e\},B\_\{e\}\+i,\\xi\_\{e\}^\{\+\}\)\-Y\(x\_\{e\},B\_\{e\}\+j,\\xi\_\{e\}^\{\-\}\)\.\(6\)LetAAbe the edge–vertex incidence matrix, with a\+1\+1atiiand−1\-1atjj\. We estimate
b^=argminb:𝟏⊤b=0∥d−Ab∥22=\(A⊤A\)\+A⊤d\.\\widehat\{b\}=\\arg\\min\_\{b:\\mathbf\{1\}^\{\\top\}b=0\}\\\|d\-Ab\\\|\_\{2\}^\{2\}=\(A^\{\\top\}A\)^\{\+\}A^\{\\top\}d\.\(7\)Under the randomized backgrounds and a common case distribution,𝔼\[d∣A\]=Ab∗\\mathbb\{E\}\[d\\mid A\]=Ab^\{\*\}and hence𝔼\[b^∣A\]=b∗\\mathbb\{E\}\[\\widehat\{b\}\\mid A\]=b^\{\*\}\. This mean identity also holds for dependent edges; variance analysis additionally requires their covariance structure\.
The prototype uses a randomly relabeled six\-vertex cycle: six paired comparisons require 12 actor calls per evolution step, or 288 across 24 evolution steps, with each of three feedback cases serving two randomly assigned edges\. Appendix[A](https://arxiv.org/html/2610.21016#A1)details exact cycle computation and its design rationale under independent, equal\-variance noise; shared cases and unequal noise reduce that idealization\.
### 4\.2Skill evolution
The next skill maximizes the fitted value, breaking exact ties by retaining more incumbent rules:
S^∈lexmaxS∈Ωk\(∑i∈Sb^i,\|S∩Mt\|\)\.\\widehat\{S\}\\in\\operatorname\*\{lexmax\}\_\{S\\in\\Omega\_\{k\}\}\\left\(\\sum\_\{i\\in S\}\\widehat\{b\}\_\{i\},\\ \|S\\cap M\_\{t\}\|\\right\)\.\(8\)A fixed random order resolves remaining ties; if every observed difference is zero, the incumbent is retained\. Misleading score differences can still cause a harmful evolution step\.
Algorithm[1](https://arxiv.org/html/2610.21016#algorithm1)in Appendix[B\.3](https://arxiv.org/html/2610.21016#A2.SS3)gives the pseudocode for one evolution step; the actor and proposal templates appear in Figures[5](https://arxiv.org/html/2610.21016#A2.F5)and[6](https://arxiv.org/html/2610.21016#A2.F6)\.
### 4\.3Decision error
LetΩ⊆Ω∗\\Omega\\subseteq\\Omega^\{\*\}, whereΩ∗\\Omega^\{\*\}is a specified reference family andΩ\\Omegais the available fixed\-capacity family\. Define the support gapg=maxS∈Ω∗V\(S\)−maxS∈ΩV\(S\)g=\\max\_\{S\\in\\Omega^\{\*\}\}V\(S\)\-\\max\_\{S\\in\\Omega\}V\(S\), approximation errorϵ=maxS∈Ω\|V\(S\)−a∗−∑i∈Sbi∗\|\\epsilon=\\max\_\{S\\in\\Omega\}\|V\(S\)\-a^\{\*\}\-\\sum\_\{i\\in S\}b\_\{i\}^\{\*\}\|, and coefficient errorη=‖b^−b∗‖∞\\eta=\\\|\\widehat\{b\}\-b^\{\*\}\\\|\_\{\\infty\}\.
###### Proposition 2\(Support, approximation, and estimation\)\.
The selection in \([8](https://arxiv.org/html/2610.21016#S4.E8)\) obeys
maxS∈Ω∗V\(S\)−V\(S^\)≤g\+2ϵ\+2min\(k,n−k\)η\.\\max\_\{S\\in\\Omega^\{\*\}\}V\(S\)\-V\(\\widehat\{S\}\)\\leq g\+2\\epsilon\+2\\min\(k,n\-k\)\\eta\.\(9\)IfMt∈ΩM\_\{t\}\\in\\Omega, thenV\(Mt\)−V\(S^\)≤2ϵ\+2min\(k,n−k\)ηV\(M\_\{t\}\)\-V\(\\widehat\{S\}\)\\leq 2\\epsilon\+2\\min\(k,n\-k\)\\eta\.
Support and approximation errors persist even with exact coefficient estimates, and numerical certification would require reliable bounds on each term\. Appendix[A](https://arxiv.org/html/2610.21016#A1)gives the proof and a complementarity counterexample\.
## 5Health calculation experiments
### 5\.1Experimental setup
The main experiment uses six MedCalc\-Bench\-Verified tasks in the order SIRS, HEART, PERC, CURB\-65, Child\-Pugh, and Cockcroft–Gault\. A shared 96\-case learning pool supplies 24 teaching and 72 feedback cases to CausalEvo and 72 training and 24 internal\-validation cases to SkillOpt\.
Comparison with no skill measures the change in performance from supplying learned rules\. Comparison with SkillOpt assesses the final skills produced by two learning procedures\. The separate shuffled\-credit ablation tests the role of assigning estimated credits to their associated rules within the exchange controller\.
We compare CausalEvo with SkillOpt\([Yang et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib18)\)and the no\-skill baseline\. CausalEvo uses the six\-cycle exchange design of Section[4\.1](https://arxiv.org/html/2610.21016#S4.SS1), with four sequential steps per task\. SkillOpt optimizes persistent textual skills for a frozen actor\. We adapt its official ReflACTTrainer to the common task and scoring interface, using four epochs with six 12\-case batches per epoch and its internal\-validation\-selected state \(step 5\)\. No skill uses the common task instruction with an empty skill\. Appendix[C\.1](https://arxiv.org/html/2610.21016#A3.SS1)provides baseline implementation details\.
The test panel contains 120 cases, 20 per task, sampled independently of model correctness\. All cases originate from the source training split, with learning and evaluation roles assigned for this study\. Record\-identifier and text\-overlap checks separate the test panel from the 96 learning cases, the 24\-case development panel, and a separate 115\-case evaluation panel\. Appendix[C](https://arxiv.org/html/2610.21016#A3)details the filtering and sampling\. These checks operate at the record and text levels; patient\-level independence remains unverified\.
Both methods learn with low reasoning and frozen model weights, with output caps of 4,096 tokens for the actor and 8,192 tokens for proposals and optimization\. We retain low reasoning during learning to support problem solving and the construction of reusable rules\. Optimization budgets and skill lengths differ between methods\.
### 5\.2Evaluation protocol
All skills and evaluated checkpoints are fixed before test evaluation\. Reported results use thinking\-off inference with the same DeepSeek V4 Flash 0731 actor, temperature 0, and a 16,384\-token output cap\. Each case receives eight independent, interleaved state evaluations: no skill, CausalEvo at steps 4, 8, 12, 16, 20, and 24, and final SkillOpt\. Case and within\-case state order are randomized\.
We disable thinking at evaluation to prioritize stable completion and inference efficiency\. This choice was motivated by reasoning\-enabled runs that could exhaust the available token budget\. Each learned skill is frozen and supplied as instruction text to the same thinking\-off actor, so the final comparison measures its utility under a common inference configuration\. Calculation criteria, units, and procedural steps remain available through the prompt in either mode, although their effect can depend on the reasoning setting\. Selection and final evaluation therefore measure skill value under their respective execution configurations, as formalized in Section[3](https://arxiv.org/html/2610.21016#S3)\.
The primary endpoint is equal\-weight task\-macro accuracy, equal to case accuracy on this balanced panel\. Unparsed answers, communication failures, and non\-normal completions count as incorrect\. Integer tasks use Python rounding against the reference answer; Cockcroft–Gault uses the inclusive reference interval\. Secondary diagnostics measure parser\-based output validity and pooled accuracy among valid outputs \(Appendix[C\.5](https://arxiv.org/html/2610.21016#A3.SS5)\)\. The 95% intervals use 20,000 task\-stratified paired bootstrap replicates\. Final\-state comparisons use exact two\-sided McNemar tests with Holm correction across three comparisons\. Intervals are unadjusted and conditional on the frozen skills and one training trajectory per method; they do not account for training variability or method\-development choices\.
### 5\.3Main results
Table[1](https://arxiv.org/html/2610.21016#S5.T1)summarizes overall accuracy and output quality on the balanced 120\-case panel\. CausalEvo answers 72 cases correctly \(60\.00%\), compared with 67 for SkillOpt \(55\.83%\) and 62 without skills \(51\.67%\)\.
Table 1:Main results on 120 held\-out cases with thinking\-off inference\. Accuracy gives equal weight to the six tasks; invalid outputs count as incorrect\. Valid\-only accuracy is a secondary diagnostic with method\-specific denominators\. Bold marks the highest observed overall accuracy\.#### Paired outcomes\.
The higher aggregate score combines corrections with losses on other cases\. Relative to no skill, CausalEvo repairs 22 errors but loses 12 previously correct answers; relative to SkillOpt, it repairs 21 and loses 16\. The paired 95% intervals are\[−0\.83,17\.50\]\[\-0\.83,17\.50\]points against no skill and\[−5\.00,13\.33\]\[\-5\.00,13\.33\]against SkillOpt\. Neither comparison is significant after Holm correction \(Appendix[C\.3](https://arxiv.org/html/2610.21016#A3.SS3)\)\.
#### Output quality\.
Both baselines return 120 valid outputs and CausalEvo returns 119, with one invalid response on Child\-Pugh; across all eight states, 959 of 960 outputs are valid and none is truncated\. The remaining errors are valid numerical answers that disagree with the reference: 47 for CausalEvo, 53 for SkillOpt, and 58 for no skill\. Appendix[C\.5](https://arxiv.org/html/2610.21016#A3.SS5)specifies the accepted formats\.
### 5\.4Task heterogeneity
Figure 2:Final task accuracy for the three frozen skill states\. Each task has 20 held\-out cases, so five percentage points equal one case\. Invalid outputs count as incorrect\. Exact values appear in Appendix[C\.4](https://arxiv.org/html/2610.21016#A3.SS4)\.Figure[2](https://arxiv.org/html/2610.21016#S5.F2)shows where the aggregate gains arise\. CausalEvo leads SkillOpt on three of six tasks, but Cockcroft–Gault alone contributes nine additional correct answers, exceeding the overall five\-case advantage\. The other five tasks therefore contribute a net loss of four\. SkillOpt leads on SIRS and PERC, while no skill performs best on Child\-Pugh\. The higher macro score thus combines task\-specific gains and regressions\.
#### Skill content and task behavior\.
Two of the four retained rules explicitly target Cockcroft–Gault, covering weight calculation and conversion precision \(Figure[7](https://arxiv.org/html/2610.21016#A3.F7)\)\. This concentration of task\-specific instructions accompanies the largest observed task\-level gain\. The other two rules address threshold logic and measurement timing; one applies its instruction to any scoring system with numeric thresholds\. All four rules are supplied to every task, so the final skill combines uneven calculator\-specific coverage with broadly scoped instructions\.
### 5\.5Learning dynamics
Figure 3:Macro accuracy over learning steps on the fixed 120\-case test panel\. Step 0 uses an empty skill\. Error bars are conditional 95% task\-stratified bootstrap intervals\. Dashed lines show no skill and the selected SkillOpt endpoint as fixed references\.#### Skill changes\.
All 24 proposal rounds are valid\. After initialization, 12 of 23 rounds change the skill and 11 retain all four incumbent rules\. The final skill contains 180 whitespace words, compared with 999 for SkillOpt, approximately 82% fewer\. Figure[7](https://arxiv.org/html/2610.21016#A3.F7)reproduces it in full\. Section[5\.7](https://arxiv.org/html/2610.21016#S5.SS7)reports training token use under these different skill representations and optimization budgets\.
#### Accuracy over learning\.
Figure[3](https://arxiv.org/html/2610.21016#S5.F3)follows CausalEvo on the same 120 cases throughout learning\. Accuracy stays at baseline through step 8, dips at step 12, and then rises, with an intervening decline at step 20, to 60\.00% at the prescribed endpoint of step 24\.
#### Task transfer\.
The final four steps add eight correct answers: three on the currently taught Cockcroft–Gault task and a net five across earlier tasks, as HEART rises from 35% to 50% and PERC from 25% to 35%\. Losses also occur: Child\-Pugh falls from 50% at step 16 to 30% at the endpoint\. Average immediate learning acquisition is−3\.33\-3\.33points \(95% interval\[−12\.50,5\.83\]\[\-12\.50,5\.83\]\), while backward and forward transfer are both\+7\.00\+7\.00points, with intervals\[−3\.00,17\.00\]\[\-3\.00,17\.00\]and\[−4\.00,18\.00\]\[\-4\.00,18\.00\]\(definitions in Appendix[C](https://arxiv.org/html/2610.21016#A3)\)\. All three intervals include zero: the endpoint gain coexists with weak immediate acquisition and an uncertain direction of transfer\.
### 5\.6Credit\-assignment ablation
Table[2](https://arxiv.org/html/2610.21016#S5.T2)isolates credit–rule correspondence within the controller\. This ablation uses a separate dataset with a relatively small test set of 24 cases, four per task\. The control permutes the six fitted credits before selection while retaining the proposal interface, candidate construction, six paired exchanges, and tie rule; each trajectory subsequently proposes from its own skill\. Training uses 24 teaching and 72 feedback cases\.
Table 2:Credit\-assignment ablation on a separate dataset with a 24\-case test set\. Phase mean averages the six phase\-end seen\-task accuracies\. Bold marks the highest observed value in each column\.Intact credits yield 17 correct answers, compared with 15 for each control, and a 4\.65\-point phase\-mean gain over shuffled credit\. The final paired gain is\+8\.33\+8\.33points \(95% interval\[−4\.17,25\.00\]\[\-4\.17,25\.00\]\)\. These estimates condition on single trajectories and a panel reused for method development\. Appendix[D](https://arxiv.org/html/2610.21016#A4)reports the protocol, phase curves, and failure diagnostics\.
### 5\.7Training token use
Across the recorded training configurations with different optimization budgets, CausalEvo uses 2\.203 million training tokens, compared with 4\.961 million for SkillOpt: a55\.6% reduction\(Figure[4](https://arxiv.org/html/2610.21016#S5.F4)\)\. Input tokens fall by 69\.8%, while output tokens, including reasoning, fall by 1\.9%\. The saving therefore comes predominantly from lower aggregate input volume\.
The exchange design specifies 12 scoring calls per evolution step\. Including one teaching call and one proposal call gives 14 requests per step and 336 over 24 steps, compared with SkillOpt’s 839 training requests\. Token volume also depends on prompt content, skill length, and generated responses\. The reported totals combine these factors with each method’s optimization schedule; the learned skills contain 180 words for CausalEvo and 999 for SkillOpt\. Call counts describe the work performed, while the input/output breakdown identifies where the token difference occurs\.
Figure 4:Training token use in the recorded configurations, whose optimization budgets differ; output includes reasoning\. Exact counts are in Appendix[C\.2](https://arxiv.org/html/2610.21016#A3.SS2)\.
## 6Discussion
CausalEvo makes the evidence for reusing a health\-agent skill explicit: which candidate skills were tested, under what capacity constraint, and with which measured outcomes\. Medical calculations provide an inspectable setting for this mechanism, while the four\-rule prototype keeps individual evolution steps small enough to examine\. Proposition[2](https://arxiv.org/html/2610.21016#Thmproposition2)separates three improvement targets: candidate coverage, interactions between rules, and estimation noise\.
The empirical findings also inform reliability evaluation\. Aggregate gains coexist with case\-level regressions\. Nearly universal output validity leaves substantial numerical error\. Evaluating an adaptive health agent therefore requires task\-level accuracy and measures of which correct answers become errors after a skill evolution step\.
A concrete extension is electronic\-record querying with clinical tools\([Jiang et al\., 2025](https://arxiv.org/html/2610.21016#bib.bib4)\)\. Rules could specify a retrieval time window, a unit check, or a tool\-call sequence\. Each paired evaluation would start from the same user request and record snapshot, sharek−1k\-1rules, and exchange the remaining rule\. A reference answer or predefined task\-completion criterion would score the resulting trajectory\. Resetting the environment between runs would prevent one run’s tool actions from changing the next run’s starting conditions\. In this mapping, the feedback case includes the query and initial environment, and the reward measures the outcome of a multi\-step interaction\.
Persistent rules also require domain review before deployment: a retained rule is a standing instruction to the model, and the controller judges it only by measured accuracy on the available cases\. The four\-rule capacity is a design choice; larger skills need more exchanges for a connected comparison graph, and the trade\-off between capacity, call budget, and estimation noise remains to be characterized\.
## 7Limitations
The evidence covers 120 static medical\-calculation cases from six previously represented calculators and one training trajectory per method; training backends, skill lengths, and optimization budgets differ\. Broader comparator coverage with matched budgets, independent learning runs, an isolated test of incumbent preservation, a comparison against exhaustive evaluation of all feasible skills, and evaluation on new calculators would strengthen the evidence\. The credit\-assignment ablation reused a development panel\. Selection can overfit its three\-case feedback panel and incurs projection error when rules interact\.
Some development labels depend on disputed choices of measurement time point or units; scores measure agreement with the frozen references\. Erroneous labels can reinforce an incorrect rule and create unwarranted confidence\. Clinical application would require independent validation and oversight appropriate to its intended use\.
## 8Conclusion
CausalEvo performs causal skill self\-evolution for health LLM agents: a frozen model proposes rules, paired fixed\-capacity exchanges estimate their relative values, and selection keeps the incumbent skill available at every step\. On 120 held\-out medical\-calculation cases it reaches 60\.00% accuracy; paired differences remain uncertain and task\-level gains vary\. Across the recorded training configurations, which use different optimization budgets, it consumes 55\.6% fewer training tokens than SkillOpt, primarily through lower input volume\. The method turns feedback into explicit, inspectable decisions about retaining or replacing reusable skills\.
## References
- Agrawal et al\. \[2026\]Lakshya A\. Agrawal, Shangyin Tan, Dilara Soylu, Noah Ziems, Rishi Khare, Krista Opsahl\-Ong, Arnav Singhvi, Herumb Shandilya, Michael J\. Ryan, Meng Jiang, Christopher Potts, Koushik Sen, Alexandros G\. Dimakis, Ion Stoica, Dan Klein, Matei Zaharia, and Omar Khattab\.GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning\.In*International Conference on Learning Representations*, 2026\.
- Chen et al\. \[2026\]Kunfeng Chen, Qihuang Zhong, Juhua Liu, and Bo Du\.SkillCAT: Contrastive, Assessment\-Augmented and Topology\-Aware Skill Self\-Evolution for LLM Agents\.*arXiv preprint arXiv:2606\.13317*, 2026\.URL[https://arxiv\.org/abs/2606\.13317](https://arxiv.org/abs/2606.13317)\.
- Jiang et al\. \[2011\]Xiaoye Jiang, Lek\-Heng Lim, Yuan Yao, and Yinyu Ye\.Statistical ranking and combinatorial Hodge theory\.*Mathematical Programming*, 127\(1\):203–244, 2011\.
- Jiang et al\. \[2025\]Yixing Jiang, Kameron C\. Black, Gloria Geng, Danny Park, James Zou, Andrew Y\. Ng, and Jonathan H\. Chen\.MedAgentBench: A Virtual EHR Environment to Benchmark Medical LLM Agents\.*NEJM AI*, 2\(9\):AIdbp2500144, 2025\.
- Khandekar et al\. \[2024\]Nikhil Khandekar, Qiao Jin, Guangzhi Xiong, Soren Dunn, Serina S Applebaum, Zain Anwar, Maame Sarfo\-Gyamfi, Conrad W Safranek, Abid A Anwar, Andrew Zhang, Aidan Gilson, Maxwell B Singer, Amisha Dave, Andrew Taylor, Aidong Zhang, Qingyu Chen, and Zhiyong Lu\.MedCalc\-Bench: Evaluating Large Language Models for Medical Calculations\.In*Advances in Neural Information Processing Systems 37, Datasets and Benchmarks Track*, 2024\.URL[https://proceedings\.neurips\.cc/paper\_files/paper/2024/hash/99e81750f3fdfcaf9613db2dbf4bd623\-Abstract\-Datasets\_and\_Benchmarks\_Track\.html](https://proceedings.neurips.cc/paper_files/paper/2024/hash/99e81750f3fdfcaf9613db2dbf4bd623-Abstract-Datasets_and_Benchmarks_Track.html)\.
- Kirkpatrick et al\. \[2017\]James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A\. Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska\-Barwinska, Demis Hassabis, Claudia Clopath, Dharshan Kumaran, and Raia Hadsell\.Overcoming catastrophic forgetting in neural networks\.*Proceedings of the National Academy of Sciences*, 114\(13\):3521–3526, 2017\.
- Kwon and Zou \[2022\]Yongchan Kwon and James Zou\.Beta Shapley: a Unified and Noise\-reduced Data Valuation Framework for Machine Learning\.In*Proceedings of The 25th International Conference on Artificial Intelligence and Statistics*, volume 151 of*Proceedings of Machine Learning Research*, pages 8780–8802\. PMLR, 2022\.URL[https://proceedings\.mlr\.press/v151/kwon22a\.html](https://proceedings.mlr.press/v151/kwon22a.html)\.
- Li et al\. \[2026\]Zhiyuan Li, Linyuan Gao, Xuechun Ding, Hongwei Chen, Yuan Wu, and Yi Chang\.CaSKG: Counterfactual\-Causal Skill Graphs for Scalable Agent Skill Retrieval\.*arXiv preprint arXiv:2608\.25500*, 2026\.URL[https://arxiv\.org/abs/2608\.25500](https://arxiv.org/abs/2608.25500)\.
- Lin et al\. \[2026\]Hongqiang Lin, Chao Liu, Xiaofan Bai, Xuan Jin, Yuhong Li, Nenggan Zheng, and Xipeng Cao\.Rethinking Self\-Evolution: A Constrained Exploration\-Exploitation Process for Mitigating Skill Overfitting\.*arXiv preprint arXiv:2607\.26643*, 2026\.URL[https://arxiv\.org/abs/2607\.26643](https://arxiv.org/abs/2607.26643)\.
- Liu et al\. \[2026\]Chang Liu, Yuqi Zhang, Yiman Zhong, Boyi Liu, Hengjun Wang, and Shuyue Wei\.SkillShapley: Boundary\-Adaptive Shapley Valuation for Skill Step Attribution in LLM Agents\.*arXiv preprint arXiv:2608\.13173*, 2026\.URL[https://arxiv\.org/abs/2608\.13173](https://arxiv.org/abs/2608.13173)\.
- Lopez\-Paz and Ranzato \[2017\]David Lopez\-Paz and Marc’Aurelio Ranzato\.Gradient Episodic Memory for Continual Learning\.In*Advances in Neural Information Processing Systems 30*, pages 6467–6476, 2017\.
- Madaan et al\. \[2023\]Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark\.Self\-Refine: Iterative Refinement with Self\-Feedback\.In*Advances in Neural Information Processing Systems 36*, pages 46534–46594, 2023\.
- MedCalc\-Bench maintainers \[2026\]MedCalc\-Bench maintainers\.MedCalc\-Bench\-Verified\.Dataset repository, 2026\.URL[https://github\.com/nikhilk7153/MedCalc\-Bench\-Verified](https://github.com/nikhilk7153/MedCalc-Bench-Verified)\.CC\-BY\-SA\-4\.0; accessed September 9, 2026\.
- Shinn et al\. \[2023\]Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao\.Reflexion: Language Agents with Verbal Reinforcement Learning\.In*Advances in Neural Information Processing Systems 36*, pages 8634–8652, 2023\.
- Wang et al\. \[2024\]Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar\.Voyager: An Open\-Ended Embodied Agent with Large Language Models\.*Transactions on Machine Learning Research*, 2024\.
- Wang and Jia \[2023\]Jiachen T\. Wang and Ruoxi Jia\.Data Banzhaf: A Robust Data Valuation Framework for Machine Learning\.In*Proceedings of The 26th International Conference on Artificial Intelligence and Statistics*, volume 206 of*Proceedings of Machine Learning Research*, pages 6388–6421\. PMLR, 2023\.URL[https://proceedings\.mlr\.press/v206/wang23e\.html](https://proceedings.mlr.press/v206/wang23e.html)\.
- Wang et al\. \[2026\]Yixuan Wang, Yiyang Zhou, Yiming Liang, Congyu Zhang, Fuxiao Liu, Jiawei Zhou, and Huaxiu Yao\.Not All Skills Help: Measuring and Repairing Agent Knowledge\.*arXiv preprint arXiv:2606\.15390*, 2026\.URL[https://arxiv\.org/abs/2606\.15390](https://arxiv.org/abs/2606.15390)\.
- Yang et al\. \[2026\]Yifan Yang, Ziyang Gong, Weiquan Huang, Qihao Yang, Ziwei Zhou, Zisu Huang, Yan Li, Xuemei Gao, Qi Dai, Bei Liu, Kai Qiu, Yuqing Yang, Dongdong Chen, Xue Yang, and Chong Luo\.SkillOpt: Executive Strategy for Self\-Evolving Agent Skills\.*arXiv preprint arXiv:2605\.23904*, 2026\.URL[https://arxiv\.org/abs/2605\.23904](https://arxiv.org/abs/2605.23904)\.
- Yuksekgonul et al\. \[2025\]Mert Yuksekgonul, Federico Bianchi, Joseph Boen, Sheng Liu, Pan Lu, Zhi Huang, Carlos Guestrin, and James Zou\.Optimizing generative AI by backpropagating language model feedback\.*Nature*, 639:609–616, 2025\.
- Zhang et al\. \[2026\]Qizheng Zhang, Changran Hu, Shubhangi Upasani, Boyuan Ma, Fenglu Hong, Vamsidhar Kamanuru, Jay Rainton, Chen Wu, Mengmeng Ji, Hanchen Li, Urmish Thakker, James Zou, and Kunle Olukotun\.Agentic Context Engineering: Evolving Contexts for Self\-Improving Language Models\.In*International Conference on Learning Representations*, 2026\.
- Zhao et al\. \[2026\]Qiyan Zhao, Xiaofeng Zhang, Bo Liu, Minda Chen, Wei Xiong, Jingyang Chen, Guanting Ye, Wenhao Yu, Xiaosong Yuan, Shijie Han, Da\-Han Wang, Jianmin Ji, Fei Huang, and Xu\-Yao Zhang\.Coalition\-Aware Skill Reliability for Self\-Evolving Agents\.*arXiv preprint arXiv:2608\.22610*, 2026\.URL[https://arxiv\.org/abs/2608\.22610](https://arxiv.org/abs/2608.22610)\.
## Appendix AProofs
All statements condition on a fixed candidate collection and a fixed value function on its size\-kksubsets\. An index denotes a particular rule string with a deterministic rendering convention\. The intervention includes the effect of inserting that text into the resulting prompt\. Semantically similar strings may have different effects\.
### A\.1Exchange identity
For a uniform size\-kkindicator vector,𝔼\[Zi\]=k/n\\mathbb\{E\}\[Z\_\{i\}\]=k/n,
Var\(Zi\)=k\(n−k\)n2,Cov\(Zi,Zj\)=−k\(n−k\)n2\(n−1\)\(i≠j\)\.\\operatorname\{Var\}\(Z\_\{i\}\)=\\frac\{k\(n\-k\)\}\{n^\{2\}\},\\qquad\\operatorname\{Cov\}\(Z\_\{i\},Z\_\{j\}\)=\-\\frac\{k\(n\-k\)\}\{n^\{2\}\(n\-1\)\}\\quad\(i\\neq j\)\.\(10\)The covariance matrix therefore acts as multiplication byq=k\(n−k\)/\[n\(n−1\)\]q=k\(n\-k\)/\[n\(n\-1\)\]on the subspace𝟏⟂\\mathbf\{1\}^\{\\perp\}\. On that subspace, the normal equations of the least\-squares projection giveqbi∗=Cov\(Zi,V\(Z\)\)qb\_\{i\}^\{\*\}=\\operatorname\{Cov\}\(Z\_\{i\},V\(Z\)\)\. The optimal intercept isa∗=𝔼\[V\(Z\)\]a^\{\*\}=\\mathbb\{E\}\[V\(Z\)\], because𝔼\[\(b∗\)⊤Z\]=0\\mathbb\{E\}\[\(b^\{\*\}\)^\{\\top\}Z\]=0\. This proves the first identity and the uniqueness of the zero\-sum coefficient vector\.
For the second identity, write
Cov\(Zi,V\)−Cov\(Zj,V\)\\displaystyle\\operatorname\{Cov\}\(Z\_\{i\},V\)\-\\operatorname\{Cov\}\(Z\_\{j\},V\)=𝔼\[\(Zi−Zj\)V\]\\displaystyle=\\mathbb\{E\}\[\(Z\_\{i\}\-Z\_\{j\}\)V\]=q\(𝔼\[V∣Zi=1,Zj=0\]−𝔼\[V∣Zi=0,Zj=1\]\)=qδij\.\\displaystyle=q\\left\(\\mathbb\{E\}\[V\\mid Z\_\{i\}=1,Z\_\{j\}=0\]\-\\mathbb\{E\}\[V\\mid Z\_\{i\}=0,Z\_\{j\}=1\]\\right\)=q\\delta\_\{ij\}\.\(11\)The two conditional backgrounds are uniform\(k−1\)\(k\-1\)\-subsets of the samen−2n\-2remaining indices\. Dividing byqqproves the result for arbitraryVV\. The derivation requires uniform averaging over these backgrounds\.□\\square
### A\.2Graph estimation
For a connected graph,L=A⊤AL=A^\{\\top\}Ahas nullspacespan\(𝟏\)\\operatorname\{span\}\(\\mathbf\{1\}\)\. If the conditional mean of each observed edge difference is the correspondingbi∗−bj∗b\_\{i\}^\{\*\}\-b\_\{j\}^\{\*\}, then
𝔼\[b^∣A\]=L\+A⊤Ab∗=b∗,\\mathbb\{E\}\[\\widehat\{b\}\\mid A\]=L^\{\+\}A^\{\\top\}Ab^\{\*\}=b^\{\*\},\(12\)sinceb∗∈𝟏⟂b^\{\*\}\\in\\mathbf\{1\}^\{\\perp\}\. With independent homoskedastic edge noise of varianceσ2\\sigma^\{2\}, the covariance on this subspace isσ2L\+\\sigma^\{2\}L^\{\+\}\. Correlated or unequal\-variance errors require a corresponding covariance adjustment\.
For a six\-cycle with verticesv0,…,v5v\_\{0\},\\ldots,v\_\{5\}and oriented differencesd0,…,d5d\_\{0\},\\ldots,d\_\{5\}, letd¯=∑ede/6\\bar\{d\}=\\sum\_\{e\}d\_\{e\}/6, setuv0=0u\_\{v\_\{0\}\}=0, and recursively setuve\+1=uve−\(de−d¯\)u\_\{v\_\{e\+1\}\}=u\_\{v\_\{e\}\}\-\(d\_\{e\}\-\\bar\{d\}\)\. Centering the sixuuvalues gives \([7](https://arxiv.org/html/2610.21016#S4.E7)\)\. The fitted differences arede−d¯d\_\{e\}\-\\bar\{d\}, and the residual sum of squares is6d¯26\\bar\{d\}^\{2\}\. A zero observed residual is compatible with nonlinear rule interactions, because the mean identity itself holds for arbitraryVV\.
By the matrix\-tree theorem, the product of the nonzero Laplacian eigenvalues isnntimes the number of spanning trees\. A connected simple graph on six vertices with six edges is unicyclic\. If its unique cycle has lengthℓ\\ell, it hasℓ\\ellspanning trees: delete one of the cycle edges, while every attached tree edge must remain\. Thusℓ≤6\\ell\\leq 6, with equality for the six\-cycle\. This proves D\-optimality only among this restricted family under the equal\-variance independent\-noise model\. In our experiment, two edges share each feedback case, and different model responses can have different variability\.
### A\.3Decision bound
LetS∗S^\{\*\}maximizeVVwithinΩ\\Omega\. The uniform approximation bound gives
V\(S∗\)−V\(S^\)≤2ϵ\+∑i∈S∗bi∗−∑i∈S^bi∗\.V\(S^\{\*\}\)\-V\(\\widehat\{S\}\)\\leq 2\\epsilon\+\\sum\_\{i\\in S^\{\*\}\}b\_\{i\}^\{\*\}\-\\sum\_\{i\\in\\widehat\{S\}\}b\_\{i\}^\{\*\}\.\(13\)BecauseS^\\widehat\{S\}maximizes the estimated coefficient sum, adding and subtractingb^\\widehat\{b\}bounds the final two sums by
∑i∈S∗∖S^\(bi∗−b^i\)−∑i∈S^∖S∗\(bi∗−b^i\)≤\|S∗△S^\|η≤2min\(k,n−k\)η\.\\sum\_\{i\\in S^\{\*\}\\setminus\\widehat\{S\}\}\(b\_\{i\}^\{\*\}\-\\widehat\{b\}\_\{i\}\)\-\\sum\_\{i\\in\\widehat\{S\}\\setminus S^\{\*\}\}\(b\_\{i\}^\{\*\}\-\\widehat\{b\}\_\{i\}\)\\leq\|S^\{\*\}\\mathbin\{\\triangle\}\\widehat\{S\}\|\\eta\\leq 2\\min\(k,n\-k\)\\eta\.\(14\)The last inequality follows because both sets have sizekkin a universe of sizenn\. Adding the support gap proves \([9](https://arxiv.org/html/2610.21016#S4.E9)\)\. IfMt∈ΩM\_\{t\}\\in\\Omega, thenV\(Mt\)≤V\(S∗\)V\(M\_\{t\}\)\\leq V\(S^\{\*\}\), giving the incumbent comparison\. Lexicographic tie\-breaking preserves the first objective, so the proof applies\.□\\square
### A\.4Complementarity counterexample
Taken=4,k=2n=4,k=2and assign values
V\(12\)=1,V\(13\)=V\(14\)=0\.6,V\(23\)=V\(24\)=0,V\(34\)=0\.9\.V\(12\)=1,\\quad V\(13\)=V\(14\)=0\.6,\\quad V\(23\)=V\(24\)=0,\\quad V\(34\)=0\.9\.\(15\)The exact zero\-sum projection coefficients are\(13,−11,−1,−1\)/40\(13,\-11,\-1,\-1\)/40\. Selecting the two largest coefficients returns\{1,3\}\\\{1,3\\\}or\{1,4\}\\\{1,4\\\}with value0\.60\.6, whereas the optimal feasible skill\{1,2\}\\\{1,2\\\}has value11\. Approximation error therefore remains even with exact coefficient estimates\.
The accompanying mathematical checker verifies the exchange identity on arbitrary finite value tables, the decision\-loss bound, this counterexample, and the restricted six\-cycle design calculation\.
## Appendix BImplementation details
This section documents the actor and proposal interfaces, the training configuration, and the pseudocode shared by the main experiment and the credit\-assignment ablation\.
### B\.1Model interfaces
Figures[5](https://arxiv.org/html/2610.21016#A2.F5)and[6](https://arxiv.org/html/2610.21016#A2.F6)show the actor and proposal templates\. Braced fields describe the variable inputs schematically; the fixed instructions retain their documented wording\.
Prompt Template for the Calculation Actor\[System\]Solve the requested medical calculation as a research exercise using the supplied patient note and calculator name\. Show a brief calculation \(maximum160 words\), then end with a separate line exactly FINAL: followed by one numeric value only, with no units or commas\. Do not provide treatment advice\. Do not output JSON\.\[Selected Rules – appended to System\]\{selected\_rules\_in\_rendering\_order\}\[User Input\]\{patient\_note\}\{calculation\_question\}Figure 5:Actor prompt\. Selected rules follow the fixed instruction; the no\-skill state leaves that field empty\. Field headings indicate message structure\.The user message contains the original patient note and question\. An output is valid only if it ends normally and the fixed numerical parser extracts an explicit answer\. Integer tasks requireround\(value\)to equal the numerical gold answer, using Python rounding\. Decimal tasks require the value to lie within the source’s inclusive lower and upper bounds\.
Prompt Template for Skill Proposals\[System\]Propose exactly\{m\}reusable medical\-calculation rules from the current rules and labeled attempt\.Each rule must state its applicability and procedure in 5–80 English words; propose additions, corrections, or compact replacements\.Treat the example as evidence, not a universal condition; exclude patient values, narratives, and treatment advice\.Return only RULE 1: through RULE\{m\}: on separate lines; the program preserves old rules and decides what to retain\.\[Current Rules\]\{current\_rules\}\[Labeled Teaching Case\]\{calculator\_name, patient\_note, question\}\{reference\_answer, reference\_explanation\}\[Actor Attempt\]\{attempt\_text, correctness, validity, finish\_reason\}Figure 6:Skill\-proposal template, withm=6m=6at initialization andm=2m=2for a nonempty incumbent\. The lower fields summarize the structured user payload\. The program selects rules from the scored comparisons\.The structured user payload contains current rules; the teaching case’s calculator name, note, question, reference answer and explanation; and the actual attempt’s text, correctness, validity, and finish reason\. Evaluation cases remain separate from this payload\. The parser requires ordered rule labels, distinct rule text, normal completion, and 5–80 English words per rule\. Exact duplication of an incumbent clause invalidates the proposal; semantic near\-duplication can pass this check\. An invalid proposal leaves the incumbent skill unchanged and is recorded\.
### B\.2Training configuration
Table[3](https://arxiv.org/html/2610.21016#A2.T3)lists the skill evolution settings\. Each feedback case has equal probability of assignment to each edge\. The estimator’s mean concerns the realized three\-case panel and its task composition; generalization to a broader health\-task distribution requires additional evidence\.
Table 3:Settings for skill evolution\.
### B\.3Pseudocode
Algorithm[1](https://arxiv.org/html/2610.21016#algorithm1)specifies one skill evolution step\. HereD\[I\]D\[I\]preserves increasing candidate\-index order,\[0\]=∅\[0\]=\\varnothing, andYYis the scored actor in \([1](https://arxiv.org/html/2610.21016#S3.E1)\)\. The proposal\-validity check follows the parser above; the ablation’s random seed schedule is given in Appendix[D\.2](https://arxiv.org/html/2610.21016#A4.SS2)\. Invalid actor outputs have score zero\.
Algorithm 1CausalEvo: one skill evolution stepInput:Frozen actorfθf\_\{\\theta\}and proposerGθG\_\{\\theta\}; skillMtM\_\{t\}with\|Mt\|∈\{0,4\}\|M\_\{t\}\|\\in\\\{0,4\\\}; labeled lessonℓt\\ell\_\{t\}with inputxtx\_\{t\}; labeled feedback casesℱt=\(xt,1,xt,2,xt,3\)\\mathcal\{F\}\_\{t\}=\(x\_\{t,1\},x\_\{t,2\},x\_\{t,3\}\); random seed schedulests\_\{t\}\.
Output:Next skill
Mt\+1M\_\{t\+1\}\.
1
k←4k\\leftarrow 4;
n←6n\\leftarrow 6;
m←n−\|Mt\|m\\leftarrow n\-\|M\_\{t\}\|
2
ot←fθ\(xt,render\(Mt\)\)o\_\{t\}\\leftarrow f\_\{\\theta\}\(x\_\{t\},\\operatorname\{render\}\(M\_\{t\}\)\)
3
Ut←Gθ\(Mt,ℓt,ot,m\)U\_\{t\}\\leftarrow G\_\{\\theta\}\(M\_\{t\},\\ell\_\{t\},o\_\{t\};m\)//Requestmmcandidate rules
4if*UtU\_\{t\}is invalidor\|unique\(Mt∥Ut\)\|≠n\|\\operatorname\{unique\}\(M\_\{t\}\\mathbin\{\\\|\}U\_\{t\}\)\|\\neq n*then
5return*MtM\_\{t\}*
6
D←Mt∥UtD\\leftarrow M\_\{t\}\\mathbin\{\\\|\}U\_\{t\};
Iold←\[\|Mt\|\]I\_\{\\mathrm\{old\}\}\\leftarrow\[\|M\_\{t\}\|\];
𝒬←∅\\mathcal\{Q\}\\leftarrow\\varnothing
7
π∼Unif\(𝔖n\)\\pi\\sim\\operatorname\{Unif\}\(\\mathfrak\{S\}\_\{n\}\);
πn\+1←π1\\pi\_\{n\+1\}\\leftarrow\\pi\_\{1\}
8
E←\(\(πe,πe\+1\)\)e=1nE\\leftarrow\\bigl\(\(\\pi\_\{e\},\\pi\_\{e\+1\}\)\\bigr\)\_\{e=1\}^\{n\}//Directed cycle
9
c←Permute\(1,1,2,2,3,3\)c\\leftarrow\\operatorname\{Permute\}\(1,1,2,2,3,3\)//Two edges per case
10for*e=1,…,ne=1,\\ldots,n*do
11
\(i,j\)←Ee\(i,j\)\\leftarrow E\_\{e\}
12
Be∼Unif\(\{B⊆\[n\]∖\{i,j\}:\|B\|=k−1\}\)B\_\{e\}\\sim\\operatorname\{Unif\}\\bigl\(\\\{B\\subseteq\[n\]\\setminus\\\{i,j\\\}:\|B\|=k\-1\\\}\\bigr\)
13
Se\+←D\[Be∪\{i\}\]S\_\{e\}^\{\+\}\\leftarrow D\[B\_\{e\}\\cup\\\{i\\\}\];
Se−←D\[Be∪\{j\}\]S\_\{e\}^\{\-\}\\leftarrow D\[B\_\{e\}\\cup\\\{j\\\}\]
14
𝒬←𝒬∪\{\(e,\+\),\(e,−\)\}\\mathcal\{Q\}\\leftarrow\\mathcal\{Q\}\\cup\\\{\(e,\+\),\(e,\-\)\\\}
15foreach*\(e,σ\)∈Permute\(𝒬\)\(e,\\sigma\)\\in\\operatorname\{Permute\}\(\\mathcal\{Q\}\)*do
16
zeσ←Y\(xt,ce,Seσ,ξeσ\)z\_\{e\}^\{\\sigma\}\\leftarrow Y\(x\_\{t,c\_\{e\}\},S\_\{e\}^\{\\sigma\},\\xi\_\{e\}^\{\\sigma\}\)
17
d←\(ze\+−ze−\)e=1nd\\leftarrow\(z\_\{e\}^\{\+\}\-z\_\{e\}^\{\-\}\)\_\{e=1\}^\{n\};
A←Incidence\(E\)A\\leftarrow\\operatorname\{Incidence\}\(E\)
18
b^←\(A⊤A\)\+A⊤d\\widehat\{b\}\\leftarrow\(A^\{\\top\}A\)^\{\+\}A^\{\\top\}d//Exact cycle fit; \([7](https://arxiv.org/html/2610.21016#S4.E7)\)
19
ℐ⋆←arglexmaxI⊆\[n\],\|I\|=k\(∑i∈Ib^i,\|I∩Iold\|\)\\mathcal\{I\}^\{\\star\}\\leftarrow\\underset\{I\\subseteq\[n\],\\,\|I\|=k\}\{\\operatorname\{arg\\,lexmax\}\}\\left\(\\sum\_\{i\\in I\}\\widehat\{b\}\_\{i\},\\ \|I\\cap I\_\{\\mathrm\{old\}\}\|\\right\)
20
I⋆←TieBreak\(ℐ⋆;st\)I^\{\\star\}\\leftarrow\\operatorname\{TieBreak\}\(\\mathcal\{I\}^\{\\star\};s\_\{t\}\)//Fixed candidate order
21
Mt\+1←D\[I⋆\]M\_\{t\+1\}\\leftarrow D\[I^\{\\star\}\]
22return*Mt\+1M\_\{t\+1\}*
The manuscript source includes figure\-generation code, a mathematical checker, aggregate results, and record\-role identifiers\. Complete training code and raw responses are not currently included in the package\.
## Appendix CMain experiment: supplementary protocol
The test panel is drawn from the frozen MedCalc\-Bench\-Verified source training split\. Child\-Pugh uses Synthetic cases and the other tasks use Extracted cases, following the source labels\. Overlap filtering checks record identifiers, normalized text, complete\-case matches against auxiliary evaluation records, and five\-word shingle Jaccard similarity with threshold 0\.85\. Of 824 candidates, 592 pass these checks before sampling 20 cases per task\.
Test selection uses seed 2026091001, schedule randomization uses 2026091011, and bootstrap resampling uses 2026091012\. A bootstrap draw samples 20 cases with replacement within each task, carrying all state responses together\. Exact McNemar tests use discordant pairs, and the three final\-state tests form one Holm family\. This correction applies only to the three stated comparisons\.
LetAt,jA\_\{t,j\}be accuracy on taskjjafter stagett, wheret=0t=0denotes no skill and stages 1–6 denote steps 4–24\. All entries use the same 20 test cases per task\. We report
ACC\\displaystyle\\mathrm\{ACC\}=16∑j=16A6,j,\\displaystyle=\\tfrac\{1\}\{6\}\\sum\_\{j=1\}^\{6\}A\_\{6,j\},RG\\displaystyle\\mathrm\{RG\}=16∑j=16\(A6,j−A0,j\),\\displaystyle=\\tfrac\{1\}\{6\}\\sum\_\{j=1\}^\{6\}\(A\_\{6,j\}\-A\_\{0,j\}\),LA\\displaystyle\\mathrm\{LA\}=16∑j=16\(Aj,j−Aj−1,j\),\\displaystyle=\\tfrac\{1\}\{6\}\\sum\_\{j=1\}^\{6\}\(A\_\{j,j\}\-A\_\{j\-1,j\}\),BWT\\displaystyle\\mathrm\{BWT\}=15∑j=15\(A6,j−Aj,j\),\\displaystyle=\\tfrac\{1\}\{5\}\\sum\_\{j=1\}^\{5\}\(A\_\{6,j\}\-A\_\{j,j\}\),FWT\\displaystyle\\mathrm\{FWT\}=15∑j=26\(Aj−1,j−A0,j\)\.\\displaystyle=\\tfrac\{1\}\{5\}\\sum\_\{j=2\}^\{6\}\(A\_\{j\-1,j\}\-A\_\{0,j\}\)\.SkillOpt uses mixed\-task optimization and contributes its selected endpoint to the final comparisons\. The sequential learning matrix tracks CausalEvo\. Training uses low reasoning; endpoint and checkpoint evaluation uses reasoning disabled\. Each round runs six paired exchanges on three feedback cases, fits relative rule values, and selects the top four rules\.
### C\.1Baselines
The SkillOpt comparison evaluates final skills learned from a shared case pool through a common frozen\-actor interface\. We adapt the released ReflACTTrainer using its environment interface for new tasks\. Training budgets and optimization schedules differ between methods\. The four\-rule capacity applies to CausalEvo’s candidate interventions; SkillOpt retains its own text representation\.
Other skill\-evolution systems were not run for two reasons\. At the time of writing, SkillCAT and CASS have no public code, and the CaSKG release omits its skill corpus and experiment workspace\[[Chen et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib2),[Zhao et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib21),[Li et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib8)\]\. Independently of code, each system requires protocol choices that our setup does not specify: SkillCAT and SkillBoost need multi\-trajectory collection, replay budgets, and inference\-time routing\[[Chen et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib2),[Lin et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib9)\]; SkillShapley values steps within an existing skill and needs a proposal and evolution policy to become a learning baseline\[[Liu et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib10)\]; ASSAY and CaSKG need task\-conditioned masking or retrieval\[[Wang et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib17),[Li et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib8)\]\. Established optimizers such as ACE, GEPA, and TextGrad remain relevant controls\[[Zhang et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib20),[Agrawal et al\., 2026](https://arxiv.org/html/2610.21016#bib.bib1),[Yuksekgonul et al\., 2025](https://arxiv.org/html/2610.21016#bib.bib19)\]\. Broader comparator coverage and training\-budget control remain limitations of the present evaluation\.
### C\.2Training token totals
Table[4](https://arxiv.org/html/2610.21016#A3.T4)reports aggregate usage for skill learning and optimization, separately from fixed\-skill test evaluation\. Output counts include reasoning tokens\. Total tokens equal input plus output tokens; request counts are reported separately\. The comparison uses each method’s recorded training configuration and optimization budget\.
Table 4:Training usage for the main experiment\.
### C\.3Paired statistical results
All 960 saved predictions were rescored offline with the fixed parser and reference labels, and the reported statistics were recomputed from those scores\. The final skills answer 72 cases correctly for CausalEvo, 67 for SkillOpt, and 62 for no skill\. Relative to SkillOpt, CausalEvo corrects 21 previously incorrect answers and changes 16 correct answers to incorrect ones\. Its accuracy difference is\+4\.17\+4\.17percentage points, with a conditional 95% bootstrap interval of\[−5\.00,13\.33\]\[\-5\.00,13\.33\]and Holm\-adjustedp=0\.9737p=0\.9737\. Relative to no skill, it corrects 22 answers and worsens 12, giving\+8\.33\+8\.33points, interval\[−0\.83,17\.50\]\[\-0\.83,17\.50\], and adjustedp=0\.3643p=0\.3643\. SkillOpt corrects 19 answers and worsens 14 relative to no skill, giving\+4\.17\+4\.17points, interval\[−5\.00,13\.33\]\[\-5\.00,13\.33\], and adjustedp=0\.9737p=0\.9737\. No comparison is significant after correction\. The intervals condition on the learned skills and do not capture training variability\.
### C\.4Final task accuracies
Table[5](https://arxiv.org/html/2610.21016#A3.T5)provides the values plotted in Figure[2](https://arxiv.org/html/2610.21016#S5.F2)\. Each task contains 20 held\-out cases, so one additional correct answer changes task accuracy by five percentage points\. The single invalid final CausalEvo output is retained in the Child\-Pugh denominator\.
Table 5:Final accuracy \(%\) on each task, with 20 held\-out cases per task\. Bold marks the highest observed accuracy in each column\.
### C\.5Output quality
An output is valid when its request succeeds, completion ends normally, and the fixed parser accepts one numeric answer\. The parser accepts numeric\-only responses and supported final\-line labels, so validity measures acceptance across these formats\. The aggregate records lack counts for each accepted format and the specific cause of the lone invalid output, preventing separate estimates of strictFINAL:compliance and parse\-failure rate\.
For each final state, letN=120N=120,VVbe the number of valid outputs, andCCthe number of correct answers\. Output validity isV/NV/N, and valid\-only accuracy isC/VC/V\. The latter pools the valid cases and can have a different task mixture and denominator for each method\. Overall accuracy remainsC/NC/N\. The three disjoint outcome categories in Table[6](https://arxiv.org/html/2610.21016#A3.T6)sum toNN: correct answers, valid but incorrect answers \(V−CV\-C\), and invalid outputs \(N−VN\-V\)\.
Table 6:Final\-state output decomposition on the 120\-case panel\. All values are counts\. Invalid outputs remain errors in the primary accuracy metric; truncation is one possible invalid\-output cause\.Across all eight evaluated states, validity is 959 of 960 outputs and the recorded truncation rate is zero\. This pool contains repeated evaluations of the same 120 cases\. Only failures that return no model output are eligible for a retry\. Completed answers, including formatting failures, are scored once\. The evaluation truncation count covers endpoint and checkpoint responses; the three capped SkillOpt optimizer responses belong to training\.
### C\.6A complete learned skill
Figure[7](https://arxiv.org/html/2610.21016#A3.F7)reproduces the final skill learned in the main experiment\. Two rules address thresholds and source measurements, and two specify Cockcroft–Gault procedures\. The same four\-rule skill is deployed across all six evaluation tasks\.
Final CausalEvo skill \(step 24\)RULE 1:For criteria with dual blood\-pressure thresholds \(e\.g\., SBP<<90 or DBP≤\\leq60\), award 1 point if either threshold is met, using the initial recorded BP pair\. Do not require both conditions, and do not adjust based on later measurements\.RULE 2:For any scoring system with numeric thresholds, use the exact value from the earliest set of labs and apply the stated inequalities; do not round, infer, or adjust that number even if a later representation differs\. Score within the defined categories precisely\.RULE 3:For Cockcroft\-Gault, compute adjusted weight from initial BMI and Devine ideal body weight: if underweight use actual weight; if normal use minimum\(ideal, actual\); if overweight/obese use ideal \+ 0\.4×\\times\(actual−\-ideal\)\. Then apply CrCl = \(\(140−\-age\)×\\timesadjusted weight×\\times\[0\.85 if female, else 1\]\) / \(creatinine in mg/dL×\\times72\)\.RULE 4:When converting height to inches for Cockcroft\-Gault, use the exact factor 2\.54 cm/in, retain the unrounded inch value, and keep it unrounded through ideal\-body\-weight and all subsequent steps; never round intermediate height or weight conversions before final CrCl\.Figure 7:Complete deployed skill from the main experiment at step 24\. The actor receives these four rules after its fixed task instruction\. The rule text is preserved from the saved skill artifact\.
## Appendix DCredit\-assignment ablation
This ablation tests credit–rule correspondence within the CausalEvo controller\. It uses a separate dataset with a 24\-case test set\.
### D\.1Experimental setup
The six tasks are introduced in the same order as in the main experiment, with four learning rounds each\. We compare two learning trajectories, CausalEvo and shuffled credit\. Both use the model interfaces and training configuration of Appendix[B](https://arxiv.org/html/2610.21016#A2), the same incumbent\-containing feasible sets, intervention design, and tie rule\. The control permutes the six fitted credits before assigning them to rules\. When the trajectories enter a round with identical skills, they share teaching and proposal responses; intervention calls remain separate\. After their states diverge, each trajectory proposes from its own skill\. Truncated proposals leave the skill unchanged, and invalid actor outputs score zero\.
### D\.2Dataset allocation and seeds
We use MedCalc\-Bench\-Verified, available under the CC\-BY\-SA\-4\.0 license\[[MedCalc\-Bench maintainers, 2026](https://arxiv.org/html/2610.21016#bib.bib13)\], with a fixed development allocation and unchanged reference labels: 24 teaching cases, 72 feedback cases, and 24 development evaluation cases \(four per task\)\. These learning and development records are drawn from the source training split, with separation from each other and from the main test panel established at the note\-ID and exact\-text levels\. Table[7](https://arxiv.org/html/2610.21016#A4.T7)lists the task composition\. The learning allocation contains 88 Extracted and 8 Synthetic records; evaluation contains 20 Extracted and 4 Synthetic records, using the dataset’s own note\-type labels\. The manuscript source includes a machine\-readable allocation manifest containing record identifiers and roles\.
Table 7:Fixed allocation\. Each task is introduced for four consecutive rounds\. Feedback can come from tasks introduced previously; early tasks consequently appear more often\.For round indext=0,…,23t=0,\\ldots,23, the implementation uses seeds181000\+t181000\+tfor the cycle and backgrounds,182000\+t182000\+tfor intervention order,183000\+10t\+e183000\+10t\+efor the two executions on edgeee, and184000\+t184000\+tfor final tie\-breaking\. The shuffled\-credit permutation uses the last seed plus 100000\. Teaching and proposal seeds are125000\+t125000\+tand126000\+t126000\+t\. The two policies use matched sampling schedules; stochastic model outputs may still differ\.
### D\.3Evaluation protocol
All learning states are finalized before evaluation begins\. At the end of each four\-round task phase, we evaluate every introduced task on its four development cases, yielding 84 predictions per trajectory\. The empty skill is evaluated on the 24 cases once\. The primary endpoint is final task\-macro accuracy; with four cases per task, this equals final case accuracy\. A secondary endpoint averages the six phase\-end accuracies over the tasks introduced by each phase; that curve reflects both performance changes and the expanding task mixture, and empty\-skill outcomes are reused to compute the corresponding changing\-mixture reference\.
Bootstrap intervals use 10,000 draws, sampling four paired cases with replacement independently within each of the six task strata, with random\-number generator seed 188000\. This analysis reuses the evaluation panel for method development and includes one learning trajectory per method; the intervals quantify case\-sampling uncertainty conditional on the two realized trajectories and do not account for method\-development choices\.
### D\.4Results
Table[2](https://arxiv.org/html/2610.21016#S5.T2)shows that CausalEvo answers 17 of 24 development cases correctly, compared with 15 for each control\. Its phase\-mean advantage over shuffled credit is 4\.65 percentage points \(Figure[8](https://arxiv.org/html/2610.21016#A4.F8)\)\. The paired final difference from shuffled credit is\+8\.33\+8\.33percentage points, with a conditional 95% interval of\[−4\.17,25\.00\]\[\-4\.17,25\.00\]\. The difference from no skill is also\+8\.33\+8\.33points, with interval\[0\.00,16\.67\]\[0\.00,16\.67\]\. All 24 final answers are valid for both learned trajectories; 23 are valid for no skill\.
Figure 8:Accuracy at each phase end on all tasks introduced so far\. The evaluated task mixture expands with each phase\.
### D\.5Diagnostics
#### Paired outcomes\.
Both gains over the empty skill occur on HEART, where both methods produced complete, valid answers\. Relative to shuffled credit, the intact\-credit trajectory gains one case each on HEART, Child\-Pugh, and Cockcroft–Gault, and loses one PERC case\. All four discordant pairs have valid outputs on both sides, so the differences reflect answer correctness; case identifiers are retained in the evidence files\. In the PERC loss, the intact\-credit trajectory returns a criterion count opposite to the reference, illustrating a task\-level failure despite the aggregate gain\.
#### Learning dynamics\.
CausalEvo makes 20 valid proposals in 24 rounds, changes its skill in 12 evolution steps, and encounters four truncated proposals\. The shuffled control makes 23 valid proposals and changes its skill in 10 rounds\. Across valid evolution steps, 18 of 120 exchange edges in CausalEvo and 13 of 138 in the control have nonzero binary differences; seven and thirteen steps, respectively, have all\-zero edges\. The measured distinctions between paired skill sets are therefore sparse\.
#### Skill content\.
The final CausalEvo skill’s four rules first appear in rounds 9, 22, 23, and 24\. Two express near\-duplicate body\-weight procedures, one retains an editing reference to a rule number that can change after subset selection, and a unit\-conversion rule includes a broadly worded time\-point instruction\. The control retains broader unit and source\-value instructions\. Both final documents provide incomplete explicit coverage of the six named calculation procedures, exposing limitations in semantic coverage and coherent composition\. The last exchange graph has zero residual alongside the redundant final rules, illustrating the distinction between graph fit and skill\-set quality\.
## Appendix EUse of large language models
DeepSeek serves as the frozen actor and proposer\. An LLM\-based coding assistant supported implementation, mathematical exposition, literature organization, and drafting\.相似文章
SkillNEO:智能体技能的非精英进化优化
SkillNEO 提出非精英进化优化方法来改进大语言模型智能体的技能,通过允许低奖励版本继续迭代并分析版本间差异来保留有效步骤、修复失败,使 GPT-5.4 Mini 在 86 项 SkillsBench 任务上的平均奖励从 49.1% 提升至 66.4%,且改进后的技能还能提升更强模型的表现。
@dair_ai: // MetaSkill-Evolve // 关于自我改进代理的优秀论文。大多数自我改进代理重写代理所做的并……
MetaSkill-Evolve 引入了一个递归的双时间尺度框架,用于LLM代理,使其能够同时进化任务技能和改进过程本身,在OfficeQA、SealQA和ALFWorld基准测试上取得了显著的准确性提升。
重新思考自我进化:一种受约束的探索-利用过程以缓解技能过拟合
本文提出SkillBoost,一种三阶段的受约束探索-利用框架,用于缓解LLM智能体自我进化中的技能过拟合。它在23个模型-基准配置上达到了最先进的性能,并证明了优化后的技能可以迁移到其他智能体。
SkillCAT:对比性评估与拓扑感知的LLM智能体技能自我进化
SkillCAT是一个无需训练的LLM智能体技能自我进化框架,通过三个阶段解决单轨迹偏差、未经验证的合并和全语料库加载等问题:对比因果提取、评估增强进化和拓扑感知任务执行,在基准测试上实现高达40.40%的提升。
Practice Makes Unsafe: Skill Misevolution in Self-Improving LLM Agents
This paper introduces SkillMisevo-Gym and SkillMisevo-Bench to study how self-improving LLM agents can evolve unsafe skills from compromised experience, plus SafeEvolve as a mitigation wrapper. Experiments across 25 agent-method configurations show skill misevolution is widespread and can persist across sessions, though SafeEvolve reduces fresh-session harm significantly.