Google Introduces WikiSkill for Persistent Agent Learning (22 minute read)

# WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
Source: [https://arxiv.org/html/2608.27454](https://arxiv.org/html/2608.27454)
\\uselogo

Cyrus RashtchianAffiliation:Google ResearchChun\-Sung FerngAffiliation:Google ResearchAndrew TomkinsAffiliation:Google ResearchDa\-Cheng JuanAffiliation:Google ResearchTu VuCorresponding author:lytang@google\.com, ttvu@google\.comAffiliation:Google ResearchAffiliation:Virginia Tech

###### Abstract

*Agent skills*package specialized knowledge and workflows into reusable resources that extend AI agent capabilities\. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction\. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations\. We introduceWikiSkill, a framework that co\-evolves agent skills with a*persistent*knowledge base \(wiki\)\. At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on\. Across diverse benchmarks and models, WikiSkill consistently outperforms*state\-of\-the\-art*skill\-evolution methods and improves over no\-skill baselines in most model\-benchmark settings\. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them\. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self\-evolved skills\. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution\. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills\.

Figure 1:WikiSkill consistently improves over both the no\-skill baseline and existing skill\-evolution methods\.Interestingly, its advantage becomes more pronounced for stronger models\. We report average accuracy across the evaluated benchmarks for each model using no skills or skills evolved by EvoSkill, SkillOpt, and WikiSkill \(see Table[1](https://arxiv.org/html/2608.27454#S4.T1)for details\)\.## 1Introduction

General\-purpose AI agents are increasingly capable of performing complex tasks across domains\([Patwardhan et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib1);[Jackson et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib2);[Merrill et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib3);[Phan et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib4)\)\. However, reliably accomplishing real\-world tasks often requires domain\-specific expertise \(e\.g\., procedural knowledge and workflows\)\.*Agent skills*\([Zhang et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib5);[Li et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib33);[Chen et al\., 2026a](https://arxiv.org/html/2608.27454#bib.bib43);[Liu et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib45)\)provide a lightweight, open format for capturing such expertise without updating model parameters\. At its core, a skill packages instructions, scripts, and other resources into a reusable filesystem\-based module \(i\.e\., an organized directory\)\([Zhang et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib5);[Li et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib33);[Anthropic, 2026](https://arxiv.org/html/2608.27454#bib.bib24);[Xia et al\., 2026b](https://arxiv.org/html/2608.27454#bib.bib38)\)\. This design makes specialized knowledge consistent, auditable, and reusable across skill\-compatible agents\. It also supports*progressive disclosure*\([Jiang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib6)\), where agents only load relevant content at any given time, which saves context space\. More broadly, skills provide a natural mechanism for accumulating knowledge independently of model parameters\.

Developing effective skills, however, remains challenging\. Most agent skills are manually authored, which requires anticipating the procedural knowledge and workflows that an agent will need\([Li et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib33);[Liang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib7);[Xu and Yan, 2026](https://arxiv.org/html/2608.27454#bib.bib46)\)\. This challenge motivates recent work that iteratively develops agent skills by executing agents on training tasks, analyzing successful and failed trajectories, and refining skills based on the resulting experience\([Yuksekgonul et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib8);[Agrawal et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib32);[Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9);[Ni et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib10);[Ouyang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib11);[Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12)\)\.

A key design question is how to preserve and organize what an agent learns throughout skill evolution\. Prior work addresses this question in different ways\. EvoSkill\([Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9)\)maintains a cumulative history of prior proposals and their evaluation outcomes; Trace2Skill\([Ni et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib10)\)extracts and consolidates lessons across execution trajectories into skill updates; and SkillOpt\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12)\)uses rejected\-edit feedback and epoch\-wise meta guidance\. However, these methods do not maintain what has been learned as a separate, evolving knowledge representation\. Inspired by[Karpathy \(2026\)](https://arxiv.org/html/2608.27454#bib.bib13)’s perspective onLLM Wiki, which advocates compiling experience into persistent, compounding knowledge, we ask:*Can agent experience be similarly compiled into persistent knowledge to support long\-term skill evolution?*We introduceWikiSkill, which adds a structured knowledge layer between raw experience and executable procedures \(i\.e\., skills\)\. This layer allows skill development to build on increasingly well\-supported and integrated knowledge across iterations, rather than on knowledge scattered across skill\-evolution artifacts\.

WikiSkill organizes the agent workspace into three layers: a*Raw Layer*that stores immutable execution traces, a*Wiki Layer*that maintains structured knowledge, and a*Skill Layer*that contains evolving procedural knowledge \(Figure[2](https://arxiv.org/html/2608.27454#S3.F2)\)\. Each iteration involves four components: an*Inference Agent*that executes rollouts using the current skills, a*Wiki Maintainer*that consolidates traces into the wiki, a*Skill Proposer*that uses the wiki and traces to propose skill updates, and a*Gating and Rollback mechanism*that retains updates that improve validation performance\. While skill updates can be rolled back, the wiki persists so that future updates can build on accumulated knowledge\. At a high level, these components form a continual loop in which experience is consolidated into persistent knowledge that supports skill evolution\.

We evaluate WikiSkill across*five*benchmarks spanning mathematical reasoning \(LiveMathematicanBench\([He et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib14)\)\), web search \(SealQA\([Pham et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib15)\)\), spreadsheet manipulation \(SpreadSheetBench\([Ma et al\., 2024](https://arxiv.org/html/2608.27454#bib.bib16)\)\), long\-context document question answering \(OfficeQA\([Singhvi et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib17)\)\), and interactive embodied tasks \(ALFWorld\([Shridhar et al\., 2021](https://arxiv.org/html/2608.27454#bib.bib18)\)\), using*five*models from the Qwen\([Qwen Team, 2026a](https://arxiv.org/html/2608.27454#bib.bib19);[Qwen Team, 2026b](https://arxiv.org/html/2608.27454#bib.bib20)\), Gemma\([Gemma Team, 2026](https://arxiv.org/html/2608.27454#bib.bib21)\), and Gemini\([Google DeepMind, 2026](https://arxiv.org/html/2608.27454#bib.bib22)\)families\. We find that WikiSkill outperforms existing skill\-evolution methods and improves over no skills in most settings\. Interestingly, skill evolution complements model scaling\. Within the Qwen family, WikiSkill improves average performance by 12\.3%, 17\.5%, and 23\.9% for 4B, 9B, and 27B models, respectively,*with gains increasing with model scale*\. At the same time, evolved skills can compensate for substantial model scale: Qwen\-3\.5\-9B with WikiSkill outperforms Qwen\-3\.6\-27B without skills \(47\.4% vs\. 39\.4%\)\. We further find that evolved skills transfer effectively across model families and can outperform self\-evolved skills\. On ALFWorld, for example, Qwen\-3\.5\-9B reaches 70\.2% with a Qwen\-3\.6\-27B\-evolved skill, compared with 63\.4% using its own skill\. These results suggest that skill discovery and skill execution are distinct capabilities\. Finally, our analysis shows that the persistent wiki is critical to these gains, supporting our hypothesis that accumulating and refining knowledge across iterations improves skill evolution\.

In summary, our main contributions are:

- •We introduce WikiSkill, a framework that co\-evolves agent skills with a persistent knowledge base that continually organizes and refines knowledge from agent experience\.
- •We demonstrate across five benchmarks and five models that WikiSkill consistently outperforms existing skill\-evolution methods, with ablations confirming the importance of persistent knowledge accumulation\.
- •We systematically study how evolved skills interact with model capability, showing that skill evolution complements model scaling and that evolved skills can transfer effectively across models, sometimes outperforming self\-evolved skills\.

Taken together, we hope that our work will spur more fundamental research on how agents can accumulate, organize, and reuse knowledge from experience\.

## 2Problem Setup

We formalize the task of iterative skill evolution for LLM agents\. Let𝒟=\{\(xi,yi\)\}i=1N\\mathcal\{D\}=\\\{\(x\_\{i\},y\_\{i\}\)\\\}\_\{i=1\}^\{N\}be a dataset of tasks, wherexix\_\{i\}denotes a task instance andyiy\_\{i\}denotes its ground\-truth answer\. We partition𝒟\\mathcal\{D\}into three disjoint splits: training tasks𝒟train\\mathcal\{D\}\_\{\\text\{train\}\}, validation tasks𝒟val\\mathcal\{D\}\_\{\\text\{val\}\}, and testing tasks𝒟test\\mathcal\{D\}\_\{\\text\{test\}\}\.

An agentπ\\piis an LLM\-based system equipped with a set of tools𝒰\\mathcal\{U\}\(e\.g\., a bash shell, search APIs, or file readers\) and an active skill setS=\{s1,s2,…,sM\}S=\\\{s\_\{1\},s\_\{2\},\\dots,s\_\{M\}\\\}\. A skill is a modular, filesystem\-based directory that packages domain\-specific procedural knowledge into instructions, scripts, and other resources\([Zhang et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib5);[Li et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib33);[Chen et al\., 2026a](https://arxiv.org/html/2608.27454#bib.bib43);[Liu et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib45)\)\. Specifically, each skill contains aSKILL\.mdfile with frontmatter metadata \(a unique name and concise description\) alongside full procedural instructions and applicability conditions\. The skill setSSis initialized to empty \(∅\\emptyset\) and developed for each dataset through the evolution process\.

When executing a taskxix\_\{i\}, the agent receives the task contextxix\_\{i\}and access to the available skillsSS\. The agent interacts with the environment over multiple steps using its tools and skills to generate an execution trajectoryτi∼π⁡\(xi,S\)\\tau\_\{i\}\\sim\\pi\(x\_\{i\};S\)\. The trajectoryτi=\(o1,a1,o2,a2,…,oT,aT\)\\tau\_\{i\}=\(o\_\{1\},a\_\{1\},o\_\{2\},a\_\{2\},\\dots,o\_\{T\},a\_\{T\}\)consists of observationsoto\_\{t\}and actionsata\_\{t\}\(which may include calls to tools in𝒰\\mathcal\{U\}\)\. The final actionaTa\_\{T\}emits a predicted answery^i\\hat\{y\}\_\{i\}\. The correctness of the prediction is evaluated by a domain\-specific scoring functionf⁡\(y^i,yi\)∈\[0,1\]f\(\\hat\{y\}\_\{i\},y\_\{i\}\)\\in\[0,1\]\. For any task split𝒟split⊂𝒟\\mathcal\{D\}\_\{\\text\{split\}\}\\subset\\mathcal\{D\}, rolling out the agentπ⁡\(⋅,S\)\\pi\(\\cdot;S\)across all task instances in𝒟split\\mathcal\{D\}\_\{\\text\{split\}\}yields a corresponding set of execution trajectories𝒯split=\{τi∼π\(xi;S\)\}\(xi,yi\)∈𝒟split\\mathcal\{T\}\_\{\\text\{split\}\}=\\\{\\tau\_\{i\}\\sim\\pi\(x\_\{i\};S\)\\\}\_\{\(x\_\{i\},y\_\{i\}\)\\in\\mathcal\{D\}\_\{\\text\{split\}\}\}\. The performance on a task splitℛ⁡\(𝒯split\)\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{split\}\}\)is the average score across all task instances\(xi,yi\)∈𝒟split\(x\_\{i\},y\_\{i\}\)\\in\\mathcal\{D\}\_\{\\text\{split\}\}\.

In WikiSkill, the system state at iterationkkis represented by the tuple\(Sk,Wk\)\(S\_\{k\},W\_\{k\}\), whereSk=\{s1,…,sM\}S\_\{k\}=\\\{s\_\{1\},\\dots,s\_\{M\}\\\}denotes the active procedural skill set andWkW\_\{k\}denotes the persistent knowledge base \(Wiki\)\. While candidate skill updates are subject to validation gating and rollback upon score degradation, the knowledge baseWkW\_\{k\}persists and compounds across iterations\. Starting from\(S0,W0\)=\(∅,∅\)\(S\_\{0\},W\_\{0\}\)=\(\\emptyset,\\emptyset\), WikiSkill co\-evolves the joint state\(Sk,Wk\)\(S\_\{k\},W\_\{k\}\)across iterationsk∈\{1,…,K\}k\\in\\\{1,\\dots,K\\\}, leveraging training rollouts𝒯train,k\\mathcal\{T\}\_\{\\text\{train\},k\}, pattern consolidation, and validation gating based on𝒯val,k\\mathcal\{T\}\_\{\\text\{val\},k\}to maximize final test performanceℛ⁡\(𝒯test\)\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{test\}\}\)on unseen tasks𝒟test\\mathcal\{D\}\_\{\\text\{test\}\}\.

## 3Methodology

![Refer to caption](https://arxiv.org/html/2608.27454v1/wikiskill-diagram.png)Figure 2:Overview of the WikiSkill framework\.The agent workspace is structured into three layers: immutable execution traces \(Raw Layer\), a persistent knowledge base that compounds across iterations \(Wiki Layer\), and active procedural instructions \(Skills Layer\)\. In each evolutionary loop, the Inference Agent runs rollouts \(injecting active skills but restricting Wiki access\), the Wiki Maintainer consolidates traces into the Wiki, and the Skill Proposer \(with the ReAct mechanism\) suggests updates while the Wiki is retained across all iterations\.We present WikiSkill, a framework that co\-evolves agent skills and a persistent knowledge base \(wiki\)\. Built around a three\-layer knowledge architecture \(§[3\.1](https://arxiv.org/html/2608.27454#S3.SS1)\), WikiSkill executes an orchestrated evolutionary loop in which the agent runs rollouts, a Wiki Maintainer consolidates traces and updates the wiki, a Skill Proposer proposes skill updates, and a gating mechanism filters changes \(§[3\.2](https://arxiv.org/html/2608.27454#S3.SS2)\)\.

### 3\.1Three\-Layer Knowledge Architecture

The WikiSkill workspace consists of three distinct layers, as shown in Figure[2](https://arxiv.org/html/2608.27454#S3.F2)and described below\.

##### Raw Layer \(raw/\)

This layer stores the raw execution tracesτi∈𝒯train,k\\tau\_\{i\}\\in\\mathcal\{T\}\_\{\\text\{train\},k\}collected from training examples in each iteration\. These traces capture the agent’s complete step\-by\-step interactions, including reasoning, tool calls, tool\-call outputs, and final answers\. In our setup, the Wiki Maintainer and Skill Proposer agents can access these raw traces to analyze agent behavior\. To preserve the raw history, this layer is immutable\.

##### Wiki Layer \(wiki/\)

This layer compiles raw traces into structured, compounding knowledge and is maintained throughout skill evolution\. It contains a pattern directory \(patterns/\) populated with individual markdown files that document specific failure modes or successful strategies, along with actionable workarounds\. Crucially, this layer provides long\-term historical awareness across optimization iterations through an evolution log \(logs\.md, updated by the Wiki Maintainer\) and a skill impact tracker \(skill\-impact\.md, updated programmatically by the outer\-loop harness after validation gating\)\. These records allow the Wiki Maintainer and Skill Proposer to \(1\) observe the complete skill acceptance history so that rejected interventions are not proposed again, \(2\) track what was proposed in prior iterations and whether those proposals succeeded, and \(3\) identify which errors recur across iterations\. The wiki is not reset between iterations, but rather accumulates and compiles knowledge continuously throughout the evolution process\.

##### Skills Layer \(skills/\)

This layer contains the active set of evolved skillsSS, which encode the procedural knowledge that the Inference Agent can read\. Each skill directory in WikiSkill contains two files:SKILL\.md, which contains the full content of the skill; andPURPOSE\.md, which maps the skill back to the motivating Wiki patterns that inspired its creation or modification\. A detailed example of interactions between the Skill Layer and the Wiki Layer is illustrated in Figure[3](https://arxiv.org/html/2608.27454#S5.F3)and explained in the case study in Section[5\.3](https://arxiv.org/html/2608.27454#S5.SS3)\.

### 3\.2Evolutionary Agents and Wiki Orchestration

The WikiSkill loop consists of four components\. In each iteration, theInference Agent\(§[3\.2\.1](https://arxiv.org/html/2608.27454#S3.SS2.SSS1)\) executes tasks using the active skills inskills/, producing immutable execution traces inraw/\. During the training rollouts, the Inference Agent is restricted from accessing the Wiki Layer, as our ablation study \(§[5\.1](https://arxiv.org/html/2608.27454#S5.SS1)\) shows that allowing wiki access during training negatively affects skill development\. Next, theWiki Maintainer\(§[3\.2\.2](https://arxiv.org/html/2608.27454#S3.SS2.SSS2)\) analyzes these raw traces alongside the existingwiki/layer to diagnose failures and extract successful strategies, updating the persistent pattern catalog and evolution logs\. TheSkill Proposer\(§[3\.2\.3](https://arxiv.org/html/2608.27454#S3.SS2.SSS3)\) then reviews the updated wiki and reads execution traces from the latest iteration to generate or modify candidate skills inskills/\. Finally, aGating and Rollbackmechanism \(§[3\.2\.4](https://arxiv.org/html/2608.27454#S3.SS2.SSS4)\) evaluates the candidate skills on a validation split, accepting successful modifications or rolling back the skill set if the changes degrade performance\. The entire evolution algorithm is described in Algorithm[1](https://arxiv.org/html/2608.27454#alg1)in Appendix[A](https://arxiv.org/html/2608.27454#A1)\.

#### 3\.2\.1Skill Provisioning for the Inference Agent

At iterationkk, the Inference Agentπ\\piis conditioned on the active skill setSk−1S\_\{k\-1\}and executes a multi\-turn trajectory using environment tools𝒰\\mathcal\{U\}:

τi∼π⁡\(xi,Sk−1\)\\tau\_\{i\}\\sim\\pi\(x\_\{i\};S\_\{k\-1\}\)\(1\)In WikiSkill, the full content of active skillsSk−1S\_\{k\-1\}is injected directly into the Inference Agent’s system prompt\. Following prior work\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12);[Ni et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib10)\), this full\-injection setting ensures that procedural instructions are immediately available during task execution, thereby eliminating skill triggering or retrieval failures as confounding variables in our study\.

#### 3\.2\.2Wiki Maintainer: Pattern Consolidation

At iterationkk, after obtaining rollout traces𝒯train,k\\mathcal\{T\}\_\{\\text\{train\},k\}on the training split𝒟train\\mathcal\{D\}\_\{\\text\{train\}\}, we sample a subset of successful and failing execution traces𝒯sample,k⊂𝒯train,k\\mathcal\{T\}\_\{\\text\{sample\},k\}\\subset\\mathcal\{T\}\_\{\\text\{train\},k\}\(see Appendix[C](https://arxiv.org/html/2608.27454#A3)for sampling budget and stratification criteria\) to avoid context window limitations\. The Wiki Maintainer agentℳWM\\mathcal\{M\}\_\{\\text\{WM\}\}consolidates these observations into the persistent wikiWk−1W\_\{k\-1\}, producing the intermediate wiki stateWk′W^\{\\prime\}\_\{k\}:

Wk′←ℳWM​\(Wk−1,𝒯sample,k\)W^\{\\prime\}\_\{k\}\\leftarrow\\mathcal\{M\}\_\{\\text\{WM\}\}\(W\_\{k\-1\},\\mathcal\{T\}\_\{\\text\{sample\},k\}\)\(2\)The Wiki Maintainer agent receives the full wiki contextWk−1W\_\{k\-1\}alongside sampled traces𝒯sample,k\\mathcal\{T\}\_\{\\text\{sample\},k\}\. It performs root cause analysis on the failing tasks, and extracts successful strategies from the passing tasks\. In each iteration, the Wiki Maintainer can create new pattern pages underwiki/patterns/and update existing pattern pages with new evidence or refined solutions\. Updates to pattern pages are applied using incremental, patch\-based editing \(e\.g\., appending, replacing, or inserting text spans\)\. Whenever patterns are modified, the Wiki Maintainer revises theindex\.mdcatalog to reflect the current state and appends a summary of the iteration’s findings to the evolution loglogs\.md\. There is no hard limit on the number of patterns created or updated per iteration; the Wiki Maintainer decides what updates are warranted based on the traces and the current wiki state\.

#### 3\.2\.3Wiki\-Informed Skill Proposer

The ProposerℳP\\mathcal\{M\}\_\{\\text\{P\}\}is an LLM\-based agent responsible for skill discovery and refinement\. At iterationkk, the proposer operates in a multi\-turn ReAct style\([Yao et al\., 2023](https://arxiv.org/html/2608.27454#bib.bib34)\)\. To avoid context window exhaustion when analyzing long execution histories, the proposer is not given a fixed set of pre\-sampled traces; instead, it is initially provided with the wiki indexI⁡\(Wk′\)I\(W^\{\\prime\}\_\{k\}\), the historical skill impact tracker \(skill\-impact\.md\), and a concise summary of all training task outcomes \(pass/fail status, predictions and ground\-truth answers\)\. Operating as an autonomous agent, it actively reasons and uses environment tools \(read\_file\) to select and inspect specific pattern pages and raw execution tracesτi∈𝒯train,k\\tau\_\{i\}\\in\\mathcal\{T\}\_\{\\text\{train\},k\}on demand to diagnose root causes before synthesizing a proposalPkP\_\{k\}:

Pk←ℳP​\(Wk′,Sk−1,𝒯train,k\)P\_\{k\}\\leftarrow\\mathcal\{M\}\_\{\\text\{P\}\}\(W^\{\\prime\}\_\{k\},S\_\{k\-1\},\\mathcal\{T\}\_\{\\text\{train\},k\}\)\(3\)In each iteration, the Skill Proposer produces an atomic proposalPkP\_\{k\}that targets a single skill, either creating a new skill or applying an incremental, patch\-based edit to the targeted existing skill\.

#### 3\.2\.4Gating and Rollback

Once a proposalPkP\_\{k\}is generated, it is applied to the workspace to yield a candidate skill setSk′=Apply​\(Sk−1,Pk\)S^\{\\prime\}\_\{k\}=\\text\{Apply\}\(S\_\{k\-1\},P\_\{k\}\)\. The system evaluatesSk′S^\{\\prime\}\_\{k\}on the validation split𝒟val\\mathcal\{D\}\_\{\\text\{val\}\}, obtaining validation traces𝒯val,k\\mathcal\{T\}\_\{\\text\{val\},k\}and scoreℛ⁡\(𝒯val,k\)\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\)\. The acceptance decision is governed by:

Sk←\{Sk′if​ℛ​\(𝒯val,k\)\>ℛbestSk−1otherwiseS\_\{k\}\\leftarrow\\begin\{cases\}S^\{\\prime\}\_\{k\}&\\text\{if \}\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\)\>\\mathcal\{R\}\_\{\\text\{best\}\}\\\\ S\_\{k\-1\}&\\text\{otherwise\}\\end\{cases\}\(4\)If accepted, the candidate skills are preserved as the new active skill setSkS\_\{k\}, and the benchmark performance thresholdℛbest\\mathcal\{R\}\_\{\\text\{best\}\}is updated toℛ⁡\(𝒯val,k\)\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\)\. Prior to the evolution loop,ℛbest\\mathcal\{R\}\_\{\\text\{best\}\}is initialized to the baseline validation scoreℛ⁡\(𝒯val,0\)\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},0\}\)obtained by evaluating the empty skill setS0S\_\{0\}on𝒟val\\mathcal\{D\}\_\{\\text\{val\}\}\. If the validation score reaches the maximum \(ℛbest=1\.0\\mathcal\{R\}\_\{\\text\{best\}\}=1\.0\) at any point during evolution, the evolution loop terminates early\. If rejected, the system discards the candidate skill modifications and reverts the skill set to the most recent successful configurationSk−1S\_\{k\-1\}\. Notably, the wikiWkW\_\{k\}is never rolled back regardless of the acceptance decision; accumulated patterns and logs persist across all iterations to ensure long\-term knowledge retention\. Following each validation evaluation, the outer\-loop orchestration harness programmatically appends an entry towiki/skill\-impact\.mdviaWk←Update​\(Wk′,Pk,ℛ⁡\(𝒯val,k\),ak\)W\_\{k\}\\leftarrow\\text\{Update\}\(W^\{\\prime\}\_\{k\},P\_\{k\},\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\),a\_\{k\}\), recording the proposal metadata, target skill name, unified diff of the modification, validation scoreℛ⁡\(𝒯val,k\)\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\), and final acceptance outcomeak∈\{Accepted,Rejected\}a\_\{k\}\\in\\\{\\text\{Accepted\},\\text\{Rejected\}\\\}\. This completes the wiki state transitionWk−1→WkW\_\{k\-1\}\\to W\_\{k\}for iterationkk, providing an objective, ground\-truth audit trail of past interventions that the Skill Proposer can consult in subsequent iterations to avoid repeating failed modifications\.

## 4Experiments and Results

### 4\.1Experimental Setup

##### Datasets

We evaluate across five benchmarks spanning diverse domains: mathematical reasoning \(LiveMathematicianBench \(LiveMath\)\([He et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib14)\)\), web search \(SealQA\([Pham et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib15)\)\), spreadsheet manipulation \(SpreadsheetBench \(SpreadSheet\)\([Ma et al\., 2024](https://arxiv.org/html/2608.27454#bib.bib16)\)\), long\-context document question answeringOfficeQA\([Singhvi et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib17)\)\), and interactive embodied tasks \(ALFWorld\([Shridhar et al\., 2021](https://arxiv.org/html/2608.27454#bib.bib18)\)\)\. Dataset details and statistics are provided in Appendix[B](https://arxiv.org/html/2608.27454#A2)\.

##### Baselines

We compare WikiSkill against three representative skill\-evolution baselines, including Trace2Skill\([Ni et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib10)\), EvoSkill\([Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9)\), and SkillOpt\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12)\), all of which share the same general loop of rolling out an agent, analyzing execution traces, proposing skill modifications, and gating changes via validation\. We also evaluate each model without skills as a no\-skill baseline\. A detailed description and an analysis of the complexity of optimizer API calls across these frameworks are provided in Appendix[D](https://arxiv.org/html/2608.27454#A4)\. We focus our comparison on dedicated skill\-evolution frameworks rather than general automatic prompt optimizers \(e\.g\., GEPA\([Agrawal et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib32)\)\), following prior work that shows specialized skill\-evolution pipelines consistently outperform general prompt optimization methods\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12)\)\.

##### Models

We experiment with both closed and open\-weight models to evaluate WikiSkill and the baselines\. For closed models, we useGemini\-3\.5\-Flash\([Google DeepMind, 2026](https://arxiv.org/html/2608.27454#bib.bib22)\)\. For open\-weight models, we evaluateQwen\-3\.5\-4B/9B\-Instruct\([Qwen Team, 2026a](https://arxiv.org/html/2608.27454#bib.bib19)\),Qwen\-3\.6\-27B\([Qwen Team, 2026b](https://arxiv.org/html/2608.27454#bib.bib20)\), andGemma\-4\-31B\-It\([Gemma Team, 2026](https://arxiv.org/html/2608.27454#bib.bib21)\), which we deploy using the vLLM framework\([Kwon et al\., 2023](https://arxiv.org/html/2608.27454#bib.bib23)\)\.

### 4\.2Main Results

ModelMethodLiveMathSealQASpreadSheetOfficeQAALFWorldAvg\.Qwen\-3\.5\-4BNo skill29\.132\.514\.630\.224\.426\.2Trace2Skill31\.537\.617\.531\.042\.832\.1EvoSkill41\.737\.318\.629\.541\.533\.7SkillOpt48\.733\.314\.034\.545\.335\.2WikiSkill49\.739\.421\.128\.553\.738\.5Qwen\-3\.5\-9BNo skill28\.226\.324\.335\.934\.729\.9Trace2Skill33\.136\.926\.538\.448\.836\.7EvoSkill58\.134\.535\.434\.948\.542\.3SkillOpt48\.729\.429\.038\.055\.740\.2WikiSkill56\.343\.133\.640\.563\.447\.4Qwen\-3\.6\-27BNo skill33\.927\.540\.842\.152\.839\.4Trace2Skill36\.337\.353\.354\.355\.547\.3EvoSkill57\.332\.959\.552\.564\.253\.3SkillOpt51\.934\.553\.254\.859\.250\.7WikiSkill61\.941\.681\.753\.777\.663\.3Gemma\-4\-31BNo skill33\.930\.648\.343\.350\.441\.3Trace2Skill32\.337\.758\.543\.257\.245\.8EvoSkill29\.838\.456\.439\.952\.643\.4SkillOpt40\.136\.163\.144\.461\.949\.1WikiSkill56\.741\.268\.044\.264\.454\.9Gemini\-3\.5\-FlashNo skill33\.029\.450\.548\.685\.949\.5Trace2Skill41\.944\.356\.050\.085\.955\.6EvoSkill44\.643\.655\.451\.285\.956\.1SkillOpt49\.728\.266\.149\.885\.955\.9WikiSkill72\.644\.776\.660\.785\.968\.1Table 1:Method comparison across inference models and test sets\. Each horizontal block evaluates a specific inference model without skills \(No skill\) and with skills developed by different skill\-evolution methods\. To ensure a fair comparison,*all skill\-evolution methods start with an empty skill set, and evolved skills are injected into the Inference Agent’s prompt at inference time*\. All reported scores are the average test performance across three independent runs of the full evolution process\. Our method \(WikiSkill\) is highlighted\. Bold indicates the best performance for each dataset; multiple bold results indicate methods that are not significantly different from the best under a paired bootstrap test with 1,000 iterations \(p<0\.05p<0\.05\)\.We evaluate WikiSkill across models and tasks and study whether evolved skills transfer across models\. Table[1](https://arxiv.org/html/2608.27454#S4.T1)presents the main skill\-evolution results across models and tasks, including how the benefits of skill evolution vary with model scale, while Table[2](https://arxiv.org/html/2608.27454#S4.T2)presents the cross\-model skill transfer results\. We analyze these results in detail below\.

To account for variability, we repeat the full evolution process across three independent runs for each method, and all reported scores represent the average test performance across the three resulting evolved skill sets\. Statistical significance of performance differences is evaluated using paired bootstrap testing atp<0\.05p<0\.05\(Appendix[C](https://arxiv.org/html/2608.27454#A3)\)\. Note that for Gemini\-3\.5\-Flash on ALFWorld, all evolution methods yield the same performance \(85\.9%\) as the no\-skill baseline because Gemini\-3\.5\-Flash achieves a 100% score on the validation split \(𝒟val\\mathcal\{D\}\_\{\\text\{val\}\}\) before skill evolution\. This also explains why Gemini\-3\.5\-Flash is marked with ‘−\-’ as a skill source on ALFWorld in the cross\-model transfer evaluation \(Table[2](https://arxiv.org/html/2608.27454#S4.T2)\)\.

#### 4\.2\.1Skill Evolution Across Models and Tasks

##### WikiSkill yields consistent improvements across models and datasets

As shown in Table[1](https://arxiv.org/html/2608.27454#S4.T1), WikiSkill achieves the highest average performance across all five models\. Compared with the strongest competing skill\-evolution method for each model, WikiSkill improves average performance by 3\.3, 5\.1, 10\.0, 5\.8, and 12\.0 points for Qwen\-3\.5\-4B, Qwen\-3\.5\-9B, Qwen\-3\.6\-27B, Gemma\-4\-31B, and Gemini\-3\.5\-Flash, respectively\. These improvements are consistent across settings: WikiSkill improves over the no\-skill baseline in most model\-dataset pairs and matches or exceeds the strongest competing method across all models in the average performance across 5 datasets\. The improvements also span diverse domains and can be substantial\. For example, WikiSkill improves Gemini\-3\.5\-Flash from 33\.0% to 72\.6% on LiveMath and from 50\.5% to 76\.6% on SpreadSheet, while improving Qwen\-3\.6\-27B from 52\.8% to 77\.6% on ALFWorld\. In contrast, existing skill\-evolution methods are less consistent\. For example, EvoSkill improves Qwen\-9B substantially on LiveMath \(28\.2%→\\rightarrow58\.1%\) but degrades Gemma\-4\-31B on the same benchmark \(33\.9 %→\\rightarrow29\.8%\), while SkillOpt degrades Gemini\-3\.5\-Flash on SealQA \(29\.4 %→\\rightarrow28\.2%\)\. These results show that WikiSkill produces both stronger and more reliable improvements across settings\.

##### The benefits of skill evolution increase with model capability and complement model scaling

Within the Qwen family, the average improvement from WikiSkill increases with model scale, from \+12\.3 points for Qwen\-3\.5\-4B to \+17\.5 points for Qwen\-3\.5\-9B and \+23\.9 points for Qwen\-3\.6\-27B\. This trend is particularly pronounced on SpreadSheet, where WikiSkill improves the three models by \+6\.5, \+9\.3, and \+40\.9 points, respectively, showing that the benefits of skill evolution can increase substantially with model scale\. At the same time, evolved skills can compensate for substantial differences in model scale: Qwen\-3\.5\-9B with WikiSkill reaches 47\.4% average accuracy, outperforming Qwen\-3\.6\-27B without skills at 39\.4%, while Qwen\-3\.5\-4B with WikiSkill reaches 38\.5%\. Our results suggest that model capability and evolved procedural knowledge provide complementary sources of performance: stronger models can derive greater value from skill evolution by developing and executing more effective skills, while effective skills can allow smaller models to outperform substantially larger models that do not use skills\.

##### The benefits of skill evolution also vary substantially across datasets

Our results suggest that some datasets are more amenable to skill evolution than others\. For Qwen\-3\.6\-27B, WikiSkill improves performance by 11\.6 points on OfficeQA and 14\.1 points on SealQA, compared with 24\.8 points on ALFWorld, 28\.0 points on LiveMath, and 40\.9 points on SpreadSheet\. Similar differences appear across other models\. LiveMath consistently benefits from skill evolution, with gains ranging from 20\.6 to 39\.6 points across all five models, while ALFWorld yields gains of 14\.0 to 29\.3 points across the four models for which WikiSkill evolves skills \(excluding Gemini\-3\.5\-Flash due to early stopping\)\. In contrast, OfficeQA presents unique challenges due to its long\-context document\-retrieval requirements\. Larger models effectively leverage evolved search workflows to navigate lengthy documents \(e\.g\., \+11\.6 points for Qwen\-3\.6\-27B and \+12\.1 points for Gemini\-3\.5\-Flash\), whereas Qwen\-3\.5\-4B struggles to execute these multi\-step search workflows across long contexts and reverts to its default reading behavior, resulting in slight degradation\.

ModelSkill SourceLiveMathSealQASpreadSheetOfficeQAALFWorldQwen\-3\.5\-4BNone29\.132\.514\.630\.224\.4Qwen\-3\.5\-4B49\.739\.421\.128\.553\.7Qwen\-3\.6\-27B59\.738\.833\.025\.457\.0Gemini\-3\.5\-Flash62\.637\.323\.032\.2\-Qwen\-3\.5\-9BNone28\.226\.324\.335\.934\.7Qwen\-3\.5\-4B61\.040\.425\.040\.369\.2Qwen\-3\.5\-9B56\.343\.133\.640\.563\.4Qwen\-3\.6\-27B59\.140\.450\.539\.970\.2Gemini\-3\.5\-Flash53\.039\.648\.840\.5\-Qwen\-3\.6\-27BNone33\.927\.540\.842\.152\.8Qwen\-3\.5\-4B62\.641\.640\.652\.972\.1Qwen\-3\.6\-27B61\.941\.681\.753\.777\.6Gemini\-3\.5\-Flash65\.151\.076\.052\.5\-Gemma\-4\-31BNone33\.930\.648\.343\.350\.4Qwen\-3\.5\-4B73\.138\.837\.142\.166\.9Qwen\-3\.6\-27B73\.737\.772\.044\.266\.9Gemma\-4\-31B56\.741\.268\.044\.264\.4Gemini\-3\.5\-Flash61\.837\.768\.843\.4\-Gemini\-3\.5\-FlashNone33\.029\.450\.548\.685\.9Qwen\-3\.5\-4B67\.540\.018\.148\.587\.3Qwen\-3\.6\-27B73\.943\.563\.447\.786\.8Gemini\-3\.5\-Flash72\.644\.776\.660\.7\-Table 2:Cross\-model skill transfer results\.We evaluate inference models using no skills \(None\) and skills evolved by WikiSkill with Qwen\-3\.5\-4B, Qwen\-3\.6\-27B, and Gemini\-3\.5\-Flash as source models\. Skills are injected into the Inference Agent’s system prompt at inference time\. Highlighted rows indicate self\-evolved skills, where the inference model and skill source are the same\. The highest performance per benchmark within each model block is bolded\. ‘−\-’ indicates that the source model reached 100% validation performance before skill evolution, so no skill was evolved\.

#### 4\.2\.2Cross\-Model Skill Transfer with WikiSkill

##### Evolved skills transfer effectively across models, and transferred skills can outperform self\-evolved skills

Table[2](https://arxiv.org/html/2608.27454#S4.T2)evaluates how skills evolved by WikiSkill transfer across inference models when developed using different source models\. Transferred skills frequently outperform both the no\-skill baseline and self\-evolved skills\. For example, Qwen\-3\.6\-27B skills improve Qwen\-3\.5\-9B to 50\.5% on SpreadSheet, compared with 24\.3% without skills and 33\.6% with self\-evolved skills, and improve Gemma\-4\-31B to 73\.7% on LiveMath, compared with 33\.9% and 56\.7%, respectively\. Notably, effective transfer also occurs from smaller to larger models: Qwen\-3\.5\-4B skills improve Gemma\-4\-31B to 73\.1% on LiveMath and 66\.9% on ALFWorld\. Our results indicate that stronger source models do not necessarily produce better skills and that procedural knowledge developed by one model’s experience can transfer across model scales and families\.

##### The transferability of evolved skills depends on whether they capture general procedures or model\-specific workarounds

Our results in Table[2](https://arxiv.org/html/2608.27454#S4.T2)suggest that WikiSkill can produce both general procedural knowledge that transfers across models and model\-specific strategies that can cause negative transfer\. LiveMath skills transfer particularly well across models: Qwen\-3\.5\-4B and Qwen\-3\.6\-27B skills improve Gemini\-3\.5\-Flash from 33\.0% to 67\.5% and 73\.9%, respectively\. In contrast, SpreadSheet exhibits strong source\-target interactions\. Qwen\-3\.5\-4B skills reduce Gemini\-3\.5\-Flash performance from 50\.5% to 18\.1%, while Qwen\-3\.6\-27B skills improve it to 63\.4%\. Our error analysis identifies two factors behind this negative transfer\. First, Qwen\-3\.5\-4B skills encode low\-level workarounds, such as single\-line Python commands and string\-conversion rules, which help the smaller model avoid execution failures but constrain stronger models such as Gemini\-3\.5\-Flash from using comprehensive end\-to\-end scripts\. Second, fragmented diagnostic procedures introduce redundant tool calls that can exhaust Gemini\-3\.5\-Flash’s interaction budget before task completion\.

##### The utility of transferred skills also depends on the inference model’s ability to execute them

We now turn toward how different inference models use skills developed by the same source model\. Within the Qwen family, stronger models can derive greater value from the same procedural knowledge\. For example, Qwen\-3\.6\-27B SpreadSheet skills improve Qwen\-3\.5\-4B, Qwen\-3\.5\-9B, and Qwen\-3\.6\-27B over their no\-skill baselines by 18\.4%, 26\.2%, and 40\.9%, respectively\. OfficeQA provides a case where a model develops skills that are more useful to another model than to itself: Qwen\-3\.5\-4B skills decrease its own performance from 30\.2% to 28\.5%, but improve Qwen\-3\.6\-27B from 42\.1% to 52\.9%\. Our trajectory analysis suggests that in long\-context settings, smaller models can become distracted by lengthy document contexts and fail to follow detailed multi\-step search instructions, instead reverting to their default document\-reading behavior\. Stronger models, in contrast, more reliably execute the structured navigation procedures specified by the skill across long contexts\. Taken together, these results distinguish two capabilities that self\-evolution normally conflates: discovering useful procedural knowledge from experience and effectively executing that knowledge at inference time\.

## 5Analysis and Discussion

### 5\.1Role of Persistent Knowledge in Skill Evolution

To understand where persistent knowledge contributes to skill evolution, we ablate wiki access for the two components that can use it during evolution \(Table[3](https://arxiv.org/html/2608.27454#S5.T3)\)\. Specifically, using Gemini\-3\.5\-Flash, we independently vary wiki access for the Inference Agent during training rollouts and the Skill Proposer during skill development, which results in four configurations\. When the Skill Proposer has no wiki access, we also remove the Wiki Maintainer, eliminating persistent knowledge accumulation across iterations\. Our default WikiSkill configuration gives wiki access to the Skill Proposer but not the Inference Agent\.

WikiSkill ComponentsBenchmarksInference AgentSkill ProposerLiveMathSealQASpreadSheetOfficeQAAvg\.Wiki AccessWiki AccessNo skill33\.029\.450\.548\.640\.443\.842\.044\.451\.045\.351\.338\.449\.955\.248\.764\.842\.880\.255\.660\.972\.644\.776\.660\.763\.7Table 3:Ablation study on WikiSkill using Gemini\-3\.5\-Flash\.We evaluate performance across benchmarks under four configurations that vary whether the Inference Agent and Skill Proposer have wiki access during skill evolution\. When the Skill Proposer has no Wiki access, we also remove the Wiki Maintainer, eliminating persistent knowledge accumulation across iterations\. The bottom row represents our default WikiSkill configuration\.##### Persistent wiki knowledge dramatically improves skill evolution

As shown in Table 3, when wiki access for the Inference Agent is disabled, providing the Skill Proposer with access to the persistent wiki increases average benchmark performance from 48\.7% to 63\.7% \(\+15\.0%\), with substantial gains on LiveMath \(51\.3% to 72\.6%\) and SpreadsheetBench \(49\.9% to 76\.6%\)\. Without persistent knowledge accumulated across iterations, the Skill Proposer struggles to resolve intricate failure modes\.

##### Wiki access for the Inference Agent during evolution degrades final skill quality

When the Skill Proposer has access to the persistent wiki, providing the Inference Agent with wiki access during training rollouts reduces average benchmark performance from 63\.7% to 60\.9%, with a substantial drop on LiveMath from 72\.6% to 64\.8%\. We hypothesize that when the Inference Agent has access to both skills and the wiki during training rollouts, some task\-solving knowledge may be obtained directly from the wiki rather than the skills, which can make the resulting trajectories less informative for skill development\.

### 5\.2Qualitative Analysis: Skill and Wiki Dynamics

To better understand how WikiSkill evolves knowledge and skills across models and datasets, we analyze the wiki patterns accumulated and skills produced during evolution \(Table[4](https://arxiv.org/html/2608.27454#S5.T4)\) and when successful skill updates are accepted across iterations \(Appendix Table[5](https://arxiv.org/html/2608.27454#A2.T5)\)\.

##### WikiSkill continuously accumulates wiki patterns while producing concise skills

Table[4](https://arxiv.org/html/2608.27454#S5.T4)summarizes the creation and editing of skills and wiki patterns across models and benchmarks, along with their average lengths\. Across models, Qwen models produce longer procedural skills \(118\.9\-128\.6 lines\), whereas Gemma\-4\-31B and Gemini\-3\.5\-Flash produce more compact skills \(45\.1 and 81\.2 lines, respectively\)\. Wiki pattern accumulation also varies across models, with 6\.3\-8\.9 patterns created and 7\.0–18\.4 edits on average\. Across benchmarks, SpreadSheet produces the longest skills \(142\.5 lines\) and most wiki patterns \(9\.8\), whereas LiveMath produces the shortest skills \(84\.6 lines\) and fewest wiki patterns \(4\.4\)\. Overall, these results show that both skill structure and wiki accumulation vary across models and datasets\.

![Refer to caption](https://arxiv.org/html/2608.27454v1/wiki-demo.png)Figure 3:Case study of Wiki\-guided skill evolution on ALFWorld \(Qwen\-3\.6\-27B\)\. The persistent Wiki Layer compiles cross\-iteration patterns, an audit trail of past proposal diffs and acceptance decisions, and chronological history\. Informed by the rejection of the skill proposal at Iteration 0, the proposer synthesizes the accepted skill update at Iteration 1, and later refines it with new pattern evidence\. File contents are simplified for clarity\.
##### Skill refinement continues throughout the evolution process

Appendix Table[5](https://arxiv.org/html/2608.27454#A2.T5)groups accepted skill updates into early \(Iterations 0–1\), middle \(Iterations 2–4\), and late \(Iterations 5–7\) stages\. Across models, the initial stage accounts for 39%\-52% of accepted updates, with substantial fractions continuing into the middle and late stages\. A similar pattern holds across benchmarks, where 39%\-58% of accepted updates occur during the initial stage\. Continued refinement is particularly pronounced on SealQA, where 33% of accepted updates occur in the middle stage and 28% in the late stage\. Combined with the ablation in Section[5\.1](https://arxiv.org/html/2608.27454#S5.SS1), these results suggest that persistent knowledge accumulation supports continued skill refinement across iterations\. The Wiki Layer preserves recurring errors, rejected proposals, and evolution history, which provide the Skill Proposer with accumulated context for subsequent updates\. Below, we present a case study that illustrates how this accumulated knowledge informs skill evolution\.

### 5\.3Case Study: Anatomy of Wiki\-Guided Skill Evolution

To illustrate how the Wiki and Skill Layers interact during evolution, we trace a concrete example from Qwen\-3\.6\-27B on ALFWorld, as shown in Figure[3](https://arxiv.org/html/2608.27454#S5.F3)\(simplified for presentation\)\.

At Iteration 0, the Wiki Maintainer identifies a basic looping behavior \(take\-examine\-move\-loop\.md\), while the Skill Proposer proposesgoal\-directed\-action, which fails to improve performance on the validation set and is rejected\. Crucially,skill\-impact\.mdpreserves the proposal diff and rejection outcome, allowing subsequent skill updates to account for this failed attempt\.

Informed by this audit trail, the Skill Proposer createsbreak\-repetition\-loopat Iteration 1 with a concrete action rule \(*Never Return an Item to Its Origin Location*\), which is accepted\. As new loop variants emerge across rollouts \(multi\-operation\-loop\.md\), the Wiki Maintainer accumulates new evidence in the persistent wiki\. Guided by these accumulated wiki patterns and newly stored trajectories \(not shown in the figure\), the Skill Proposer further refines the skill at Iteration 4 with a new rule \(*Each Operation Type ONCE Per Item*\)\. This example illustrates how persistent knowledge from prior iterations informs subsequent skill refinement\.

CategorySkillsWiki PatternsCreate\(Proposed / Accepted\)Edit\(Proposed / Accepted\)Avg\.LengthCreateEditAvg\.LengthBy Model \(All\-Dataset Average\)Qwen\-3\.5\-4B3\.1 / 1\.64\.9 / 1\.3126\.28\.818\.448\.2Qwen\-3\.5\-9B4\.6 / 1\.43\.4 / 0\.7128\.67\.310\.926\.6Qwen\-3\.6\-27B4\.4 / 1\.53\.6 / 0\.8118\.96\.517\.947\.7Gemma\-4\-31B4\.8 / 1\.33\.2 / 0\.845\.16\.313\.723\.7Gemini\-3\.5\-Flash2\.3 / 1\.25\.7 / 1\.181\.28\.97\.018\.1By Benchmark \(All\-Model Average\)LiveMath1\.9 / 1\.16\.1 / 1\.984\.64\.412\.131\.7SealQA4\.9 / 0\.93\.1 / 0\.498\.59\.415\.926\.9SpreadSheet4\.5 / 1\.43\.5 / 1\.1142\.59\.811\.338\.5OfficeQA4\.7 / 1\.83\.3 / 0\.3102\.98\.314\.931\.4ALFWorld3\.9 / 1\.64\.1 / 0\.893\.55\.814\.340\.6

Table 4:Statistics of evolved skills and wiki patterns across inference models \(top\) and benchmarks \(bottom\)\.For skills, we report the numbers of proposed/accepted creations and edits, along with average length in markdown lines\. For wiki patterns, we report the numbers of creations and edits, along with average length in markdown lines\. All wiki pattern creations and edits are retained\.

## 6Related Work

##### Experience\-Driven Agent Skill Evolution

Agent skills encode reusable procedural knowledge that allows LLM agents to leverage past experience for future tasks\([Zhang et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib5);[Li et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib33);[Anthropic, 2026](https://arxiv.org/html/2608.27454#bib.bib24);[Xia et al\., 2026b](https://arxiv.org/html/2608.27454#bib.bib38);[Zhou et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib37);[Wang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib41);[Xu and Yan, 2026](https://arxiv.org/html/2608.27454#bib.bib46)\)\. Recent frameworks enable agents to self\-improve by discovering and refining procedural knowledge from past execution traces\([Yuksekgonul et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib8);[Agrawal et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib32);[Ouyang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib11);[Xia et al\., 2026a](https://arxiv.org/html/2608.27454#bib.bib36);[Lu et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib42)\)\. Methods like EvoSkill\([Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9)\), Trace2Skill\([Ni et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib10)\), and SkillOpt\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12)\)use specialized agent pipelines to analyze task rollouts and update modular skill documents\([Zhang et al\., 2026b](https://arxiv.org/html/2608.27454#bib.bib39)\)\. However, these methods do not maintain what has been learned as a separate, evolving knowledge representation\. WikiSkill introduces a persistent Wiki Layer that consolidates experience into structured knowledge across iterations, allowing subsequent skill updates to build systematically on accumulated knowledge\.

##### Skill\-Augmented Agents and Agent Self\-Improvement

Beyond constructing high\-quality skills, skill\-augmented agents must effectively select and utilize relevant skills during execution\([Chen et al\., 2026a](https://arxiv.org/html/2608.27454#bib.bib43);[Liu et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib45)\)\. As the number of reusable skills grows, recent work has explored skill retrieval to select relevant skills from a library for each task\([Zheng et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib25);[Su et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib27);[Cho et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib26);[Shi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib28);[Ye et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib40)\)\. WikiSkill instead focuses on skill quality itself, separately from skill retrieval\. Another line of work optimizes the broader agent harness, including prompts, context, tools, memory, and workflows\([Lou et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib29);[Lee et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib30);[Zhang et al\., 2026a](https://arxiv.org/html/2608.27454#bib.bib35);[Chen et al\., 2026b](https://arxiv.org/html/2608.27454#bib.bib31);[Lin et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib44)\)\. These methods improve the agent system by analyzing execution traces and environment feedback to search for better agent configurations\. This direction is complementary to WikiSkill, which focuses specifically on evolving reusable procedural skills while holding the broader agent harness fixed\.

## 7Conclusion

We presented WikiSkill, a framework that co\-evolves agent skills with a persistent, compounding knowledge base \(wiki\)\. By structuring the agent workspace into three distinct layers, WikiSkill enables skill development to build on increasingly well\-supported and integrated knowledge across iterations\. An orchestrated loop consolidates experience into the wiki, proposes skill refinements from accumulated knowledge, and gates changes based on validation performance\. Empirically, WikiSkill consistently outperforms existing skill\-evolution methods across five benchmarks and five inference models and improves over no\-skill baselines in most model\-dataset pairs\. Beyond these overall gains, skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them\. At the same time, evolved skills transfer effectively across models and model families and can outperform self\-evolved skills\. Finally, our ablations confirm that persistent knowledge accumulation is critical for effective skill evolution\.

## Limitations

WikiSkill has several limitations that motivate future work\. First, to isolate skill quality and avoid confounding effects from skill retrieval, our study follows prior work by directly injecting active skills into the agent prompt\. This setup does not evaluate skill retrieval or triggering, which becomes important as the number of available skills grows\. Second, our validation gating requires each accepted proposal to improve the validation score, which excludes neutral proposals that preserve immediate performance but could enable gains in subsequent iterations\. We adopt this strict criterion following prior skill\-evolution frameworks\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12);[Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9)\)to ensure a fair comparison\. Exploring more flexible acceptance criteria is an important direction for future work\. Third, the Wiki Layer continuously accumulates pattern pages, evolution logs, and proposal diffs across iterations, but WikiSkill currently lacks an automated mechanism to prune the wiki\. Such pruning may become necessary as knowledge accumulates over longer evolution runs\. Finally, while our benchmark suite includes long\-context document reasoning \(OfficeQA\) and multi\-step tool interactions, it does not cover very long\-horizon tasks that span hundreds of environment actions or multiple hours\. Developing online skill adaptation methods that refine procedural knowledge within a single long execution rollout remains an important direction for future work\.

## AI Disclosure

Large language models and coding agents are used to aid with and polish writing and generate some tables and plots\.

## References

- Agrawalet al\.\(2026\)L\. A\. Agrawal, S\. Tan, D\. Soylu, N\. Ziems, R\. Khare, K\. Opsahl\-Ong, A\. Singhvi, H\. Shandilya, M\. J\. Ryan, M\. Jiang, C\. Potts, K\. Sen, A\. Dimakis, I\. Stoica, D\. Klein, M\. Zaharia, and O\. KhattabGEPA: reflective prompt evolution can outperform reinforcement learning\.InThe Fourteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=RQm2KQTM5r)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px2.p1.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Alzubiet al\.\(2026\)S\. Alzubi, N\. Provenzano, J\. Bingham, W\. Chen, and T\. VuEvoskill: automated skill discovery for multi\-agent systems\.arXiv preprint arXiv:2603\.02766\.External Links:[Link](https://arxiv.org/abs/2603.02766)Cited by:[Appendix B](https://arxiv.org/html/2608.27454#A2.SS0.SSS0.Px1.p1.1),[Appendix B](https://arxiv.org/html/2608.27454#A2.p3.1),[§D\.1](https://arxiv.org/html/2608.27454#A4.SS1.SSS0.Px2),[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p3.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px2.p1.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1),[Limitations](https://arxiv.org/html/2608.27454#Sx1.p1.1)\.
- Anthropic \(2026\)AnthropicA complete guide to building skills for claude\.Note:[https://claude\.com/blog/complete\-guide\-to\-building\-skills\-for\-claude](https://claude.com/blog/complete-guide-to-building-skills-for-claude)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Chenet al\.\(2026a\)S\. Chen, J\. Gai, R\. Zhou, J\. Zhang, T\. Zhu, J\. Li, K\. Wang, Z\. Wang, Z\. Chen, K\. Kaleb,et al\.Skillcraft: can llm agents learn to use tools skillfully?\.arXiv preprint arXiv:2603\.00718\.External Links:[Link](https://arxiv.org/abs/2603.00718)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1),[§2](https://arxiv.org/html/2608.27454#S2.p2.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Chenet al\.\(2026b\)T\. Chen, S\. Lu, K\. Zhao, W\. Meng, H\. Teng, T\. Li, C\. Li, X\. Liu, J\. Liang, Z\. Zhang,et al\.Harnessx: a composable, adaptive, and evolvable agent harness foundry\.arXiv preprint arXiv:2606\.14249\.External Links:[Link](https://arxiv.org/abs/2606.14249)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Choet al\.\(2026\)H\. Cho, R\. Kang, and Y\. KimSkillRet: a large\-scale benchmark for skill retrieval in llm agents\.arXiv preprint arXiv:2605\.05726\.External Links:[Link](https://arxiv.org/abs/2605.05726)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Gemma Team \(2026\)Gemma TeamGemma 4 technical report\.arXiv preprint arXiv:2607\.02770\.External Links:[Link](https://arxiv.org/abs/2607.02770)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px3.p1.1)\.
- Google DeepMind \(2026\)Google DeepMindGemini 3\.5 flash\.Note:[https://deepmind\.google/models/model\-cards/gemini\-3\-5\-flash/](https://deepmind.google/models/model-cards/gemini-3-5-flash/)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px3.p1.1)\.
- Heet al\.\(2026\)L\. He, Q\. Yu, H\. Dong, B\. Liao, X\. Xu, M\. Goldblum, J\. Bian, and N\. MesgaraniLivemathematicianbench: a live benchmark for mathematician\-level reasoning with proof sketches\.arXiv preprint arXiv:2604\.01754\.External Links:[Link](https://arxiv.org/abs/2604.01754)Cited by:[Appendix B](https://arxiv.org/html/2608.27454#A2.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px1.p1.1)\.
- Jacksonet al\.\(2025\)D\. Jackson, W\. Keating, G\. Cameron, and M\. Hill\-SmithAA\-omniscience: evaluating cross\-domain knowledge reliability in large language models\.arXiv preprint arXiv:2511\.13029\.External Links:[Link](https://arxiv.org/abs/2511.13029)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1)\.
- Jianget al\.\(2026\)Y\. Jiang, D\. Li, H\. Deng, B\. Ma, X\. Wang, Q\. Wang, and G\. YuSoK: agentic skills–beyond tool use in llm agents\.arXiv preprint arXiv:2602\.20867\.External Links:[Link](https://arxiv.org/abs/2602.20867)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1)\.
- Karpathy \(2026\)A\. KarpathyLLM Wiki\.Note:GitHub GistExternal Links:[Link](https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p3.1)\.
- Kwonet al\.\(2023\)W\. Kwon, Z\. Li, S\. Zhuang, Y\. Sheng, L\. Zheng, C\. H\. Yu, J\. Gonzalez, H\. Zhang, and I\. StoicaEfficient memory management for large language model serving with pagedattention\.InProceedings of the 29th Symposium on Operating Systems Principles,SOSP ’23,New York, NY, USA,pp\. 611–626\.External Links:ISBN 9798400702297,[Link](https://doi.org/10.1145/3600006.3613165),[Document](https://dx.doi.org/10.1145/3600006.3613165)Cited by:[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px3.p1.1)\.
- Leeet al\.\(2026\)Y\. Lee, R\. Nair, Q\. Zhang, K\. Lee, O\. Khattab, and C\. FinnMeta\-harness: end\-to\-end optimization of model harnesses\.arXiv preprint arXiv:2603\.28052\.External Links:[Link](https://arxiv.org/abs/2603.28052)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Liet al\.\(2026\)X\. Li, Y\. Liu, W\. Chen, B\. You, Z\. Di, Y\. He, S\. Zheng, K\. W\. Choe, J\. Sun, S\. Wang,et al\.SkillsBench: benchmarking how well agent skills work across diverse tasks\.arXiv preprint arXiv:2602\.12670\.External Links:[Link](https://arxiv.org/abs/2602.12670)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1),[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§2](https://arxiv.org/html/2608.27454#S2.p2.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Lianget al\.\(2026\)Y\. Liang, R\. Zhong, H\. Xu, C\. Jiang, Y\. Zhong, R\. Fang, J\. Gu, S\. Deng, Y\. Yao, M\. Wang,et al\.Skillnet: create, evaluate, and connect ai skills\.arXiv preprint arXiv:2603\.04448\.External Links:[Link](https://arxiv.org/abs/2603.04448)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p2.1)\.
- Linet al\.\(2026\)J\. Lin, S\. Liu, C\. Pan, L\. Lin, S\. Dou, Z\. Xi, X\. Huang, H\. Yan, Z\. Han, T\. Gui,et al\.Agentic harness engineering: observability\-driven automatic evolution of coding\-agent harnesses\.arXiv preprint arXiv:2604\.25850\.External Links:[Link](https://arxiv.org/abs/2604.25850)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Liuet al\.\(2026\)Y\. Liu, J\. Ji, L\. An, T\. Jaakkola, Y\. Zhang, and S\. ChangHow well do agentic skills work in the wild: benchmarking llm skill usage in realistic settings\.arXiv preprint arXiv:2604\.04323\.External Links:[Link](https://arxiv.org/abs/2604.04323)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1),[§2](https://arxiv.org/html/2608.27454#S2.p2.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Louet al\.\(2026\)X\. Lou, M\. Lázaro\-Gredilla, A\. Dedieu, C\. Wendelken, W\. Lehrach, and K\. P\. MurphyAutoharness: improving llm agents by automatically synthesizing a code harness\.arXiv preprint arXiv:2603\.03329\.External Links:[Link](https://arxiv.org/abs/2603.03329)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Luet al\.\(2026\)Z\. Lu, Z\. Yao, J\. Wu, C\. Han, Q\. Gu, X\. Cai, W\. Lu, J\. Xiao, Y\. Zhuang, and Y\. ShenSkill0: in\-context agentic reinforcement learning for skill internalization\.arXiv preprint arXiv:2604\.02268\.External Links:[Link](https://arxiv.org/abs/2604.02268)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Maet al\.\(2024\)Z\. Ma, B\. Zhang, J\. Zhang, J\. Yu, X\. Zhang, X\. Zhang, S\. Luo, X\. Wang, and J\. TangSpreadsheetBench: towards challenging real world spreadsheet manipulation\.InThe Thirty\-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track,External Links:[Link](https://openreview.net/forum?id=KYxzmRLF6i)Cited by:[Appendix B](https://arxiv.org/html/2608.27454#A2.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px1.p1.1)\.
- Merrillet al\.\(2026\)M\. A\. Merrill, A\. G\. Shaw, N\. Carlini, B\. Li, H\. Raj, I\. Bercovich, L\. Shi, J\. Y\. Shin, T\. Walshe, E\. K\. Buchanan, J\. Shen, G\. Ye, H\. Lin, J\. Poulos, M\. Wang, M\. Nezhurina, D\. Lu, O\. M\. Mastromichalakis, Z\. Xu, Z\. Chen, Y\. Liu, R\. Zhang, L\. L\. Chen, A\. Kashyap, J\. Uslu, J\. Li, J\. Wu, M\. Yan, S\. Bian, V\. Sharma, K\. Sun, S\. Dillmann, A\. Anand, A\. Lanpouthakoun, B\. Koopah, C\. Hu, E\. K\. Guha, G\. H\. S\. Dreiman, J\. Zhu, K\. Krauth, L\. Zhong, N\. Muennighoff, R\. K\. Amanfu, S\. Tan, S\. Pimpalgaonkar, T\. Aggarwal, X\. Lin, X\. Lan, X\. Zhao, Y\. Liang, Y\. Wang, Z\. Wang, C\. Zhou, D\. Heineman, H\. Liu, H\. Trivedi, J\. Yang, J\. Lin, M\. Shetty, M\. Yang, N\. Omi, N\. Raoof, S\. Li, T\. Y\. Zhuo, W\. Lin, Y\. Dai, Y\. Wang, W\. Chai, S\. Zhou, D\. Wahdany, Z\. She, J\. Hu, Z\. Dong, Y\. Zhu, S\. Cui, A\. Saiyed, A\. Kolbeinsson, C\. M\. Rytting, R\. Marten, Y\. Wang, J\. Jitsev, A\. Dimakis, A\. Konwinski, and L\. SchmidtTerminal\-bench: benchmarking agents on hard, realistic tasks in command line interfaces\.InThe Fourteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=a7Qa4CcHak)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1)\.
- Niet al\.\(2026\)J\. Ni, Y\. Liu, X\. Liu, Y\. Sun, M\. Zhou, P\. Cheng, D\. Wang, E\. Zhao, X\. Jiang, and G\. JiangTrace2skill: distill trajectory\-local lessons into transferable agent skills\.arXiv preprint arXiv:2603\.25158\.External Links:[Link](https://arxiv.org/abs/2603.25158)Cited by:[§D\.1](https://arxiv.org/html/2608.27454#A4.SS1.SSS0.Px1),[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p3.1),[§3\.2\.1](https://arxiv.org/html/2608.27454#S3.SS2.SSS1.p1.2),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px2.p1.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Ouyanget al\.\(2026\)S\. Ouyang, J\. Yan, Y\. Chen, R\. Han, Z\. Wang, B\. D\. Mishra, R\. Meng, C\. Li, Y\. Jiao, K\. Zha,et al\.Skillos: learning skill curation for self\-evolving agents\.arXiv preprint arXiv:2605\.06614\.External Links:[Link](https://arxiv.org/abs/2605.06614)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Patwardhanet al\.\(2026\)T\. Patwardhan, R\. Dias, E\. Proehl, G\. Kim, M\. Wang, O\. Watkins, S\. P\. Fishman, M\. Aljubeh, P\. Thacker, L\. Fauconnet, N\. S\. Kim, S\. Miserendino, G\. Chabot, D\. Li, P\. Chao, M\. Sharman, A\. Barr, A\. Glaese, and J\. TworekGDPval: evaluating AI model performance on real\-world economically valuable tasks\.InThe Fourteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=hcuEdq6eKD)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1)\.
- Phamet al\.\(2026\)T\. Pham, N\. P\. Nguyen, P\. Zunjare, W\. Chen, Y\. Tseng, and T\. VuSealQA: raising the bar for reasoning in search\-augmented language models\.InThe Fourteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=zWb7ueH16c)Cited by:[Appendix B](https://arxiv.org/html/2608.27454#A2.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px1.p1.1)\.
- Phanet al\.\(2026\)L\. Phan, A\. Gatti, Z\. Han, N\. Li, J\. Hu, H\. Zhang, C\. B\. C\. Zhang, M\. Shaaban, J\. Ling, S\. Shi,et al\.Humanity’s last exam\.Nature649\(8099\),pp\. 1139–1146\.External Links:ISSN 1476\-4687,[Document](https://dx.doi.org/10.1038/s41586-025-09962-4),[Link](https://doi.org/10.1038/s41586-025-09962-4)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1)\.
- Qwen Team \(2026a\)Qwen TeamQwen3\.5: towards native multimodal agents\.Note:[https://qwen\.ai/blog?id=qwen3\.5](https://qwen.ai/blog?id=qwen3.5)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px3.p1.1)\.
- Qwen Team \(2026b\)Qwen TeamQwen3\.6\-27b\.Note:[https://qwen\.ai/blog?id=qwen3\.6\-27b](https://qwen.ai/blog?id=qwen3.6-27b)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px3.p1.1)\.
- Shiet al\.\(2026\)Y\. Shi, Y\. Chen, Z\. Lu, Y\. Miao, S\. Liu, Q\. Gu, X\. Cai, X\. Wang, and A\. ZhangSkill1: unified evolution of skill\-augmented agents via reinforcement learning\.arXiv preprint arXiv:2605\.06130\.External Links:[Link](https://arxiv.org/abs/2605.06130)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Shridharet al\.\(2021\)M\. Shridhar, X\. Yuan, M\. Cote, Y\. Bisk, A\. Trischler, and M\. Hausknecht\{ALFW\}orld: aligning text and embodied environments for interactive learning\.InInternational Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=0IOX0YcCdTn)Cited by:[Appendix B](https://arxiv.org/html/2608.27454#A2.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px1.p1.1)\.
- Singhviet al\.\(2025\)A\. Singhvi, K\. Opsahl\-Ong, J\. Collins, I\. Zhou, C\. Wang, A\. Baheti, J\. Portes, S\. Havens, E\. Elsen, M\. Bendersky, M\. Zaharia, and X\. ChenIntroducing OfficeQA: a benchmark for end\-to\-end grounded reasoning\.Databricks\.Note:Databricks BlogExternal Links:[Link](https://www.databricks.com/blog/introducing-officeqa-benchmark-end-to-end-grounded-reasoning)Cited by:[Appendix B](https://arxiv.org/html/2608.27454#A2.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p5.1),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px1.p1.1)\.
- Suet al\.\(2026\)W\. Su, J\. Long, Q\. Ai, Q\. He, Y\. Tang, C\. Wang, Y\. Tu, Y\. Wang, and Y\. LiuSkill retrieval augmentation for agentic ai\.arXiv preprint arXiv:2604\.24594\.External Links:[Link](https://arxiv.org/abs/2604.24594)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Wanget al\.\(2026\)H\. Wang, Y\. Lan, B\. Cao, L\. Lin, and J\. ChenSkillGrad: optimizing agent skills like gradient descent\.arXiv preprint arXiv:2605\.27760\.External Links:[Link](https://arxiv.org/abs/2605.27760)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Xiaet al\.\(2026a\)P\. Xia, J\. Chen, H\. Wang, J\. Liu, K\. Zeng, Y\. Wang, S\. Han, Y\. Zhou, X\. Zhao, H\. Chen,et al\.Skillrl: evolving agents via recursive skill\-augmented reinforcement learning\.arXiv preprint arXiv:2602\.08234\.External Links:[Link](https://arxiv.org/abs/2602.08234)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Xiaet al\.\(2026b\)P\. Xia, J\. Chen, X\. Yang, H\. Tu, J\. Liu, K\. Xiong, S\. Han, S\. Qiu, H\. Ji, Y\. Zhou,et al\.MetaClaw: just talk–an agent that meta\-learns and evolves in the wild\.arXiv preprint arXiv:2603\.17187\.External Links:[Link](https://arxiv.org/abs/2603.17187)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Xu and Yan \(2026\)R\. Xu and Y\. YanAgent skills for large language models: architecture, acquisition, security, and the path forward\.arXiv preprint arXiv:2602\.12430\.External Links:[Link](https://arxiv.org/abs/2602.12430)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Yanget al\.\(2026\)Y\. Yang, Z\. Gong, W\. Huang, Q\. Yang, Z\. Zhou, Z\. Huang, Y\. Li, X\. Gao, Q\. Dai, B\. Liu,et al\.SkillOpt: executive strategy for self\-evolving agent skills\.arXiv preprint arXiv:2605\.23904\.External Links:[Link](https://arxiv.org/abs/2605.23904)Cited by:[Appendix B](https://arxiv.org/html/2608.27454#A2.SS0.SSS0.Px1.p1.1),[Appendix B](https://arxiv.org/html/2608.27454#A2.p2.1),[Appendix B](https://arxiv.org/html/2608.27454#A2.p3.1),[§D\.1](https://arxiv.org/html/2608.27454#A4.SS1.SSS0.Px3),[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§1](https://arxiv.org/html/2608.27454#S1.p3.1),[§3\.2\.1](https://arxiv.org/html/2608.27454#S3.SS2.SSS1.p1.2),[§4\.1](https://arxiv.org/html/2608.27454#S4.SS1.SSS0.Px2.p1.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1),[Limitations](https://arxiv.org/html/2608.27454#Sx1.p1.1)\.
- Yaoet al\.\(2023\)S\. Yao, J\. Zhao, D\. Yu, N\. Du, I\. Shafran, K\. R\. Narasimhan, and Y\. CaoReAct: synergizing reasoning and acting in language models\.InThe Eleventh International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=WE_vluYUL-X)Cited by:[§3\.2\.3](https://arxiv.org/html/2608.27454#S3.SS2.SSS3.p1.1)\.
- Yeet al\.\(2026\)H\. Ye, X\. He, V\. Arak, H\. Dong, and G\. SongMeta context engineering via agentic skill evolution\.InForty\-third International Conference on Machine Learning,External Links:[Link](https://openreview.net/forum?id=P1jHroBS5E)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Yuksekgonulet al\.\(2025\)M\. Yuksekgonul, F\. Bianchi, J\. Boen, S\. Liu, P\. Lu, Z\. Huang, C\. Guestrin, and J\. ZouOptimizing generative ai by backpropagating language model feedback\.Nature639\(8055\),pp\. 609–616\.External Links:ISSN 1476\-4687,[Document](https://dx.doi.org/10.1038/s41586-025-08661-4),[Link](https://doi.org/10.1038/s41586-025-08661-4)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p2.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Zhanget al\.\(2025\)B\. Zhang, K\. Lazuka, and M\. MuragEquipping agents for the real world with agent skills\.Note:[https://www\.anthropic\.com/engineering/equipping\-agents\-for\-the\-real\-world\-with\-agent\-skills](https://www.anthropic.com/engineering/equipping-agents-for-the-real-world-with-agent-skills)Cited by:[§1](https://arxiv.org/html/2608.27454#S1.p1.1),[§2](https://arxiv.org/html/2608.27454#S2.p2.1),[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Zhanget al\.\(2026a\)H\. Zhang, S\. Zhang, K\. Li, C\. Zhang, Y\. Chen, Y\. Zhang, L\. Bai, and S\. HuSelf\-harness: harnesses that improve themselves\.arXiv preprint arXiv:2606\.09498\.External Links:[Link](https://arxiv.org/abs/2606.09498)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Zhanget al\.\(2026b\)H\. Zhang, S\. Fan, H\. P\. Zou, Y\. Chen, Z\. Wang, J\. Zhou, C\. Li, W\. Huang, Y\. Yao, K\. Zheng,et al\.Coevoskills: self\-evolving agent skills via co\-evolutionary verification\.arXiv preprint arXiv:2604\.01687\.External Links:[Link](https://arxiv.org/abs/2604.01687)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.
- Zhenget al\.\(2026\)Y\. Zheng, Z\. Zhang, C\. Ma, Y\. Yu, J\. Zhu, Y\. Wu, T\. Xu, B\. Dong, H\. Zhu, R\. Huang,et al\.Skillrouter: skill routing for llm agents at scale\.arXiv preprint arXiv:2603\.22455\.External Links:[Link](https://arxiv.org/abs/2603.22455)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px2.p1.1)\.
- Zhouet al\.\(2026\)H\. Zhou, S\. Guo, A\. Liu, Z\. Yu, Z\. Gong, B\. Zhao, Z\. Chen, M\. Zhang, Y\. Chen, J\. Li,et al\.Memento\-skills: let agents design agents\.arXiv preprint arXiv:2603\.18743\.External Links:[Link](https://arxiv.org/abs/2603.18743)Cited by:[§6](https://arxiv.org/html/2608.27454#S6.SS0.SSS0.Px1.p1.1)\.

## Appendix AMethod Details

### A\.1Algorithm

The full skill\-evolution algorithm for WikiSkill is described in Algorithm[1](https://arxiv.org/html/2608.27454#alg1)\.

1:Training tasks

𝒟train\\mathcal\{D\}\_\{\\text\{train\}\}, validation tasks

𝒟val\\mathcal\{D\}\_\{\\text\{val\}\}, performance metric

ℛ\\mathcal\{R\}, iterations

KK
2:Initialize skill set

S0←∅S\_\{0\}\\leftarrow\\emptyset, wiki

W0←∅W\_\{0\}\\leftarrow\\emptyset
3:Baseline Validation:

𝒯val,0←\{τi∼π\(xi;S0\)\}xi∈𝒟val\\mathcal\{T\}\_\{\\text\{val\},0\}\\leftarrow\\\{\\tau\_\{i\}\\sim\\pi\(x\_\{i\};S\_\{0\}\)\\\}\_\{x\_\{i\}\\in\\mathcal\{D\}\_\{\\text\{val\}\}\},

ℛbest←ℛ⁡\(𝒯val,0\)\\mathcal\{R\}\_\{\\text\{best\}\}\\leftarrow\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},0\}\)
4:for

k=1,…,Kk=1,\\dots,Kdo

5:if

ℛbest=1\.0\\mathcal\{R\}\_\{\\text\{best\}\}=1\.0then

6:break

7:endif

8:Inference:Roll out

𝒯train,k←\{τi∼π\(xi;Sk−1\)\}xi∈𝒟train\\mathcal\{T\}\_\{\\text\{train\},k\}\\leftarrow\\\{\\tau\_\{i\}\\sim\\pi\(x\_\{i\};S\_\{k\-1\}\)\\\}\_\{x\_\{i\}\\in\\mathcal\{D\}\_\{\\text\{train\}\}\}
9:Sample subset

𝒯sample,k⊂𝒯train,k\\mathcal\{T\}\_\{\\text\{sample\},k\}\\subset\\mathcal\{T\}\_\{\\text\{train\},k\}
10:Wiki Maintenance:

Wk′←ℳWM​\(Wk−1,𝒯sample,k\)W^\{\\prime\}\_\{k\}\\leftarrow\\mathcal\{M\}\_\{\\text\{WM\}\}\(W\_\{k\-1\},\\mathcal\{T\}\_\{\\text\{sample\},k\}\)
11:Skill Proposal:

Pk←ℳP​\(Wk′,Sk−1,𝒯train,k\)P\_\{k\}\\leftarrow\\mathcal\{M\}\_\{\\text\{P\}\}\(W^\{\\prime\}\_\{k\},S\_\{k\-1\},\\mathcal\{T\}\_\{\\text\{train\},k\}\)
12:Apply:

Sk′←Apply​\(Sk−1,Pk\)S^\{\\prime\}\_\{k\}\\leftarrow\\text\{Apply\}\(S\_\{k\-1\},P\_\{k\}\)
13:Validate:

𝒯val,k←\{τi∼π\(xi;Sk′\)\}xi∈𝒟val\\mathcal\{T\}\_\{\\text\{val\},k\}\\leftarrow\\\{\\tau\_\{i\}\\sim\\pi\(x\_\{i\};S^\{\\prime\}\_\{k\}\)\\\}\_\{x\_\{i\}\\in\\mathcal\{D\}\_\{\\text\{val\}\}\}
14:if

ℛ⁡\(𝒯val,k\)\>ℛbest\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\)\>\\mathcal\{R\}\_\{\\text\{best\}\}then

15:

Sk←Sk′S\_\{k\}\\leftarrow S^\{\\prime\}\_\{k\},

ℛbest←ℛ⁡\(𝒯val,k\)\\mathcal\{R\}\_\{\\text\{best\}\}\\leftarrow\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\),

ak←Accepteda\_\{k\}\\leftarrow\\text\{Accepted\}
16:else

17:

Sk←Sk−1S\_\{k\}\\leftarrow S\_\{k\-1\},

ak←Rejecteda\_\{k\}\\leftarrow\\text\{Rejected\}⊳\\trianglerightRoll back skills only; wiki retained

18:endif

19:Update Wiki Log:

Wk←Update​\(Wk′,Pk,ℛ⁡\(𝒯val,k\),ak\)W\_\{k\}\\leftarrow\\text\{Update\}\(W^\{\\prime\}\_\{k\},P\_\{k\},\\mathcal\{R\}\(\\mathcal\{T\}\_\{\\text\{val\},k\}\),a\_\{k\}\)
20:endfor

21:return

SKS\_\{K\},

WKW\_\{K\}

Algorithm 1WikiSkill evolution loop\.At each iterationkk, the inference agent rolls out on training tasks using active skillsSk−1S\_\{k\-1\}, the maintainer consolidates sampled traces into the intermediate wikiWk′W^\{\\prime\}\_\{k\}, the proposer generates candidate skill modificationsPkP\_\{k\}, validation gating determines whether to acceptSk′S^\{\\prime\}\_\{k\}or roll back toSk−1S\_\{k\-1\}, and the system appends the proposal outcome and skill diff to produce the final wiki stateWkW\_\{k\}\.
### A\.2Distribution of Accepted Skill Updates

We show when the updated skill proposals are accepted in Table[5](https://arxiv.org/html/2608.27454#A2.T5)\.

## Appendix BDataset Details and Splits

We describe the five benchmarks used in our evaluation below\.

LiveMathematicianBench \(LiveMath\)\([He et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib14)\)consists of multiple\-choice mathematics competition problems from recent months\. It tests the model’s capacity for complex mathematical reasoning, quantifiers, and extremal conditions\.SealQA\([Pham et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib15)\)is a factual question\-answering benchmark composed of scholarly questions across various topics\. It evaluates the agent’s ability to formulate effective search queries and extract answers from web search results using a search tool\.SpreadsheetBench \(SpreadSheet\)\([Ma et al\., 2024](https://arxiv.org/html/2608.27454#bib.bib16)\)tests the agent’s ability to write correct code under library constraints \(such as formula evaluation limitations\) and execute complex table transformations\.OfficeQA\([Singhvi et al\., 2025](https://arxiv.org/html/2608.27454#bib.bib17)\)evaluates long\-context question\-answering over a large repository of historical Treasury bulletins\. Tasks require synthesizing evidence across long contexts and multi\-page financial tables\. Following the setup in[Yang et al\. \(2026\)](https://arxiv.org/html/2608.27454#bib.bib12), the agent is provided with pre\-parsed oracle reference pages as initial document evidence in the prompt, while retaining access to local text\-processing tools \(glob,grep,read\) to search, cross\-reference, and inspect full Treasury bulletin files on disk\.ALFWorld\([Shridhar et al\., 2021](https://arxiv.org/html/2608.27454#bib.bib18)\)is an interactive text\-based embodied environment where an agent solves multi\-step household tasks \(e\.g\., picking and placing objects, heating or cooling items\) by outputting text actions to a simulator\. Unlike static QA benchmarks, ALFWorld tests sequential decision\-making, spatial reasoning, and error recovery from simulator feedback\.

CategoryEarly \(Iter 0–1\)Mid \(Iter 2–4\)Late \(Iter 5–7\)By ModelQwen\-3\.5\-4B39%39%21%Qwen\-3\.5\-9B52%30%19%Qwen\-3\.6\-27B43%40%17%Gemma\-4\-31B52%37%11%Gemini\-3\.5\-Flash50%46%4%By BenchmarkLiveMath44%42%14%SealQA39%33%28%SpreadSheet41%48%11%OfficeQA58%26%16%ALFWorld55%34%10%Table 5:Distribution of accepted skill updates across evolution iterations, grouped by model \(top\) and benchmark \(bottom\)\.Percentages indicate the proportion of accepted updates that occur during each stage of evolution\.BenchmarkInteractionTrainValTestEnvironment ToolsLiveMathSingle\-Step3518124None \(Direct Reasoning\)SealQAMulti\-Step161085web\_search,read\_fileSpreadSheetMulti\-Step8040280bashOfficeQAMulti\-Step5024172glob,grep,readALFWorldMulti\-Step3918134Admissible ActionsTable 6:Benchmark statistics, data splits, interaction modes, and available environment tools\.Table[6](https://arxiv.org/html/2608.27454#A2.T6)summarizes the sample counts across training, validation, and test splits, interaction modes, and available tools for each benchmark evaluated in our experiments\. All task splits and available toolsets are strictly matched with prior work\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12);[Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9)\)\. For tool setup, LiveMath operates as a single\-step reasoning benchmark without external tools, where the model generates final answers directly; SealQA equips the agent with web search \(using Google Search API\) and file reading for multi\-step factual retrieval \(we use the July, 2026 version of SealQA for all experiments\); SpreadSheet provides abashshell tool for Python code execution and table manipulation; OfficeQA provides local text\-search utilities for multi\-step Treasury bulletin navigation; and ALFWorld provides an interactive simulator action space for multi\-step embodied decision making\.

##### Evaluation robustness with small validation sets

Following established setups in prior work\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12);[Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9)\), benchmark validation splits are relatively small, which can introduce evaluation noise into gating decision\. To account for this variability, all reported scores represent the average test performance across three independent runs of the entire evolutionary pipeline, with paired bootstrap significance testing \(detailed in Appendix[C](https://arxiv.org/html/2608.27454#A3)\)\.

## Appendix CImplementation Details

To provide diagnostic feedback for the Wiki maintainer, we apply a stratified sampling strategy \(𝒯sample,k⊂𝒯train,k\\mathcal\{T\}\_\{\\text\{sample\},k\}\\subset\\mathcal\{T\}\_\{\\text\{train\},k\}\) at each iterationkk\. Specifically, the system samples up to 8 traces per iteration, stratified into a maximum of 5 failing traces \(to perform root\-cause analysis of errors\) and up to 3 passing traces \(to identify effective strategies and prevent regressions in working behaviors\)\. Each individual execution log is capped at 15,000 characters prior to injection into the prompt\.

##### Statistical significance testing

We perform paired bootstrap significance tests with1,0001,000iterations for each benchmark\. In each bootstrap iteration, task instances are sampled with replacement from the test split𝒟test\\mathcal\{D\}\_\{\\text\{test\}\}to construct a bootstrap evaluation set of size\|𝒟test\|\|\\mathcal\{D\}\_\{\\text\{test\}\}\|, from which candidate accuracy scores and pairwise performance margins are computed\. To evaluate overall cross\-benchmark performance, we conduct stratified macro\-average bootstrap resampling: in each iteration, task instances are resampled independently with replacement within each benchmark, and we calculate macro\-average accuracy by assigning equal weight to all benchmarks\.

We determine top\-performing methods in our evaluation tables as follows\. Methods are initially ranked by their observed performance \(or macro\-average performance across benchmarks\)\. A top\-ranked methodM∗M^\{\*\}is the sole top performer if and only if it achieves a statistically significant gain over all competing methods atp<0\.05p<0\.05\. IfM∗M^\{\*\}is not statistically distinguishable \(p≥0\.05p\\geq 0\.05\) against one or more lower\-ranked methods, no single method is declared the sole top performer\. Instead, all methods whose performance is not statistically distinguishable fromM∗M^\{\*\}\(p≥0\.05p\\geq 0\.05\) are grouped into a top\-tier statistical tie \(and bolded accordingly\)\.

## Appendix DBaseline Details and Optimizer API Call Analysis

### D\.1Baseline Methods

##### Trace2Skill\([Ni et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib10)\)

Trace2Skill employs a three\-stage pipeline centered on parallel trace analysis and hierarchical merging\. It evaluates the current skill on training tasks and dispatches parallel success analysts and error analysts to extract effective strategies from passing tasks and diagnose root causes of failures\. The resulting structured patches are recursively consolidated via a hierarchical merge operator into a single patch set\. The consolidated patches are applied to the skill document and accepted based on validation performance\.

##### EvoSkill\([Alzubi et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib9)\)

EvoSkill frames skill evolution as a search over a frontier of candidate programs\. In each iteration, it samples training tasks via a round\-robin category schedule and executes rollouts\. EvoSkill feedsonlyfailure traces to the proposer alongside a flat feedback history of past proposal outcomes\. The proposer generates candidate skill modifications that are materialized intoSKILL\.mdfiles, scored on a validation split, and added to a bounded frontier of top\-performing programs\.

##### SkillOpt\([Yang et al\., 2026](https://arxiv.org/html/2608.27454#bib.bib12)\)

SkillOpt implements a six\-stageReflACTpipeline \(Rollout, Reflect, Aggregate, Select, Update, Evaluate\) for iterative skill optimization\. In each epoch, the system rolls out the agent on training tasks and reflects on full execution traces, including both successes and failures, to generate candidate patches\. These patches are hierarchically aggregated and selected to update a single monolithic skill document, which is accepted or rejected based on validation performance\.

### D\.2Optimizer API Call Complexity

In this section, we analyze optimizer API call complexity, denoted by𝒞\\mathcal\{C\}, across self\-improving agent frameworks\. We define one evolution iteration as rolling out the agent on the full training split𝒟train\\mathcal\{D\}\_\{\\text\{train\}\}once \(Ntrain=\|𝒟train\|N\_\{\\text\{train\}\}=\|\\mathcal\{D\}\_\{\\text\{train\}\}\|training task instances\), processed in minibatches of sizeBB\(B≤NtrainB\\leq N\_\{\\text\{train\}\}\)\. Table[7](https://arxiv.org/html/2608.27454#A4.T7)summarizes the per\-iteration optimizer API call complexity for WikiSkill and prior methods\.

FrameworkPer\-Iteration FormulaComplexityTrace2SkillNtrain\+\(1\+1c−1\)​NtrainB\+1N\_\{\\text\{train\}\}\+\\left\(1\+\\frac\{1\}\{c\-1\}\\right\)\\frac\{N\_\{\\text\{train\}\}\}\{B\}\+1𝒪⁡\(Ntrain\+NtrainB\)\\mathcal\{O\}\\left\(N\_\{\\text\{train\}\}\+\\frac\{N\_\{\\text\{train\}\}\}\{B\}\\right\)EvoSkill2​NtrainB\\frac\{2N\_\{\\text\{train\}\}\}\{B\}𝒪⁡\(NtrainB\)\\mathcal\{O\}\\left\(\\frac\{N\_\{\\text\{train\}\}\}\{B\}\\right\)SkillOptKopt⋅NtrainB\\frac\{K\_\{\\text\{opt\}\}\\cdot N\_\{\\text\{train\}\}\}\{B\}𝒪⁡\(NtrainB\)\\mathcal\{O\}\\left\(\\frac\{N\_\{\\text\{train\}\}\}\{B\}\\right\)WikiSkill\(1\+TReAct\)​NtrainB\(1\+T\_\{\\text\{ReAct\}\}\)\\frac\{N\_\{\\text\{train\}\}\}\{B\}𝒪⁡\(NtrainB\)\\mathcal\{O\}\\left\(\\frac\{N\_\{\\text\{train\}\}\}\{B\}\\right\)Table 7:Comparison of optimizer API call complexity per evolution iteration across self\-improving agent frameworks\.Ntrain=\|𝒟train\|N\_\{\\text\{train\}\}=\|\\mathcal\{D\}\_\{\\text\{train\}\}\|denotes the number of training tasks,BBdenotes the batch size,TReActT\_\{\\text\{ReAct\}\}denotes the number of interactive ReAct reasoning turns used by the Skill Proposer agent in WikiSkill,KoptK\_\{\\text\{opt\}\}denotes the number of reflection and merging calls per step in SkillOpt, andccdenotes the reduction\-tree branching factor in Trace2Skill\. WikiSkill usesB=NtrainB=N\_\{\\text\{train\}\}across all datasets\. In full\-batch mode, WikiSkill’s optimizer call count is independent of training set sizeNtrainN\_\{\\text\{train\}\}, requiring1\+TReAct1\+T\_\{\\text\{ReAct\}\}optimizer calls per iteration\.##### WikiSkill

For each batch of sizeBB, the Wiki Maintainer requires one LLM call to analyze sampled traces𝒯sample,k\\mathcal\{T\}\_\{\\text\{sample\},k\}and consolidate pattern pages into the intermediate wikiWk′W^\{\\prime\}\_\{k\}\. The Skill Proposer then runs as an autonomous multi\-turn ReAct agent, executing interactive tool calls overTReActT\_\{\\text\{ReAct\}\}reasoning turns \(roughly10≤TReAct≤2010\\leq T\_\{\\text\{ReAct\}\}\\leq 20across our experiment runs\), where each ReAct turn requires11LLM call\. When processing training data in batches of sizeBB, completing one full iteration overNtrainN\_\{\\text\{train\}\}tasks requiresNtrainB\\frac\{N\_\{\\text\{train\}\}\}\{B\}steps:

𝒞WikiSkill=\(1\+TReAct\)​NtrainB\\mathcal\{C\}\_\{\\text\{WikiSkill\}\}=\(1\+T\_\{\\text\{ReAct\}\}\)\\frac\{N\_\{\\text\{train\}\}\}\{B\}\(5\)In our experiments, we set the batch size to the full training size \(B=NtrainB=N\_\{\\text\{train\}\}\) across all datasets\. In this full\-batch setting \(NtrainB=1\\frac\{N\_\{\\text\{train\}\}\}\{B\}=1\),𝒞WikiSkill=1\+TReAct\\mathcal\{C\}\_\{\\text\{WikiSkill\}\}=1\+T\_\{\\text\{ReAct\}\}\. BecauseTReActT\_\{\\text\{ReAct\}\}does not depend onNtrainN\_\{\\text\{train\}\}, WikiSkill’s optimizer API call complexity is𝒪⁡\(1\)\\mathcal\{O\}\(1\)with respect to training set size\. Specifically, each iteration requires1\+TReAct1\+T\_\{\\text\{ReAct\}\}optimizer LLM calls, regardless of the number of training instances\. While this constant call complexity may incur higher inference cost on some datasets, the additional computation is accompanied by consistent performance gains over prior skill\-evolution methods across our evaluation\.

##### EvoSkill

EvoSkill partitions training tasks into minibatches of sizeBB\. For each minibatch, EvoSkill uses one Proposer LLM call for error diagnosis and one Generator LLM call for skill updates\. Processing the full training split ofNtrainN\_\{\\text\{train\}\}tasks requiresNtrainB\\frac\{N\_\{\\text\{train\}\}\}\{B\}minibatch steps, resulting in:

𝒞EvoSkill=2​NtrainB\\mathcal\{C\}\_\{\\text\{EvoSkill\}\}=\\frac\{2N\_\{\\text\{train\}\}\}\{B\}\(6\)Thus, EvoSkill’s optimizer API call complexity scales linearly with training set sizeNtrainN\_\{\\text\{train\}\}\(𝒪⁡\(Ntrain/B\)\\mathcal\{O\}\(N\_\{\\text\{train\}\}/B\)\)\.

##### SkillOpt

SkillOpt evaluates minibatches of sizeBB, completing each iteration inNtrainB\\frac\{N\_\{\\text\{train\}\}\}\{B\}optimization steps\. During each step, SkillOpt executes its ReflACT pipeline \(parallel analyst reflections, hierarchical patch synthesis, and candidate selection\), requiringKopt≈6​–​8K\_\{\\text\{opt\}\}\\approx 6\\text\{\-\-\}8optimizer LLM calls per step:

𝒞SkillOpt=Kopt⋅NtrainB\\mathcal\{C\}\_\{\\text\{SkillOpt\}\}=\\frac\{K\_\{\\text\{opt\}\}\\cdot N\_\{\\text\{train\}\}\}\{B\}\(7\)SkillOpt similarly scales linearly with training set sizeNtrainN\_\{\\text\{train\}\}, as𝒪⁡\(Ntrain/B\)\\mathcal\{O\}\(N\_\{\\text\{train\}\}/B\)\.

##### Trace2Skill

Trace2Skill processes training trajectories through a three\-stage pipeline per iteration:

1. 1\.Trace analysis stage:Every individual execution trajectory is analyzed independently with one LLM call, incurringNtrainN\_\{\\text\{train\}\}total calls\.
2. 2\.Patch map stage:Analysis records are chunked into batches of sizeBB, requiringNtrainB\\frac\{N\_\{\\text\{train\}\}\}\{B\}calls to generate local skill patches\.
3. 3\.Hierarchical reduce & apply stage:TheNtrainB\\frac\{N\_\{\\text\{train\}\}\}\{B\}local patches are recursively merged via acc\-ary reduction tree \(whereccis the branching factor\)\. Summing across levels yields≈1c−1​NtrainB\\approx\\frac\{1\}\{c\-1\}\\frac\{N\_\{\\text\{train\}\}\}\{B\}merge calls, plus one final call to format the skill document\.

Combining all stages:

𝒞Trace2Skill≈Ntrain\+\(1\+1c−1\)​NtrainB\+1\\mathcal\{C\}\_\{\\text\{Trace2Skill\}\}\\approx N\_\{\\text\{train\}\}\+\\left\(1\+\\frac\{1\}\{c\-1\}\\right\)\\frac\{N\_\{\\text\{train\}\}\}\{B\}\+1\(8\)Because Trace2Skill performs individual LLM analysis on every training trajectory \(NtrainN\_\{\\text\{train\}\}calls\), its complexity is lower\-bounded by𝒪⁡\(Ntrain\)\\mathcal\{O\}\(N\_\{\\text\{train\}\}\), scaling linearly with training set size\.

##### Full\-batch training vs\. minibatch optimization

Across all datasets, we set the batch sizeBBto the full training set size \(B=NtrainB=N\_\{\\text\{train\}\}\) for WikiSkill, processing the entire training set at once per iteration\. The Skill Proposer dynamically searches, selects, and reads specific execution traces on demand to diagnose root causes before proposing skill updates\. In contrast, EvoSkill and SkillOpt achieve their best performance under minibatch settings \(B<NtrainB<N\_\{\\text\{train\}\}\), which causes their optimizer API call complexity to scale linearly with training set size\. Finally, Trace2Skill remains strictly𝒪⁡\(Ntrain\)\\mathcal\{O\}\(N\_\{\\text\{train\}\}\)regardless of minibatch size because it requires an independent LLM call for every training trajectory\.

## Appendix ESystem and Agent Prompts

We provide the exact system prompts used for \(1\) the Inference Agent for each task across all methods, \(2\) the Wiki Maintainer, and \(3\) the Skill Proposer in WikiSkill\.

### E\.1Task Inference Agent System Prompts

LiveMathematicianBench Inference Agent System Prompt

Youareanexpertmathematicalreasoningagentsolvingmultiple\-choicequestions\.

\{skill\_section\}

\#\#TaskFormat

Youwillreceiveonemathematicsmultiple\-choicequestionanditsanswerchoices\.Reasoncarefullyaboutquantifiers,hypotheses,extremalwording,andexactequalityconditions\.

\#\#AnswerFormat

Thinkstepbystep,thenprovideyourfinalanswerinside<answer\>\.\.\.</answer\>tags\.Insidethetags,outputonlythesinglechoicelabel,suchasAorC\.

Example:

<answer\>B</answer\>

SealQA Inference Agent System Prompt

Youareaknowledgeablequestion\-answeringassistantwithaccesstoweb\_searchandread\_filetools\.

\{skill\_section\}

\#\#Task

Youwillreceiveafactualquestion\.Toanswerit:

1\.Youcanchecktheavailableskills\.Theycontainguidancethatcanimproveyoursearchqueriesandansweraccuracy\.

2\.Youcanuseweb\_searchtofindrelevantinformation\.Youcancallitmultipletimeswithdifferentqueries\.

3\.Youcandoweb\_searchanytimeduringtheprocessdependingonyourneeds\.

4\.Aftergatheringenoughinformation,provideyourfinalanswer\.

\#\#AnswerFormat

YouMUSTwrapyourfinalanswerin<answer\>tags:

<answer\>

\.\.\.yourfinalanswer\(exactvalueonly,noexplanation\)\.\.\.

</answer\>

SpreadsheetBench Inference Agent System Prompt

YouareaspreadsheetexpertwhocanmanipulatespreadsheetsthroughPythoncode\.

\{skill\_section\}

Youneedtosolvethegivenspreadsheetmanipulationquestion,whichcontainsthefollowinginformation:

\-working\_directory:Theabsolutepathtoyourworkingdirectorywherefilesarelocated\.

\-instruction:Thequestionaboutspreadsheetmanipulation\.

\-spreadsheet\_path:Theabsolutepathofthespreadsheetfileyouneedtomanipulate\.

\-spreadsheet\_content:Thefirstfewrowsofthecontentofspreadsheetfile\.

\-instruction\_type:Therearetwovalues\(Cell\-LevelManipulation,Sheet\-LevelManipulation\)usedtoindicatewhethertheanswertothisquestionappliesonlytospecificcellsortotheentireworksheet\.

\-answer\_position:Thepositionneedtobemodifiedorfilled\.ForCell\-LevelManipulationquestions,thisfieldisfilledwiththecellposition;forSheet\-LevelManipulation,itisthemaximumrangeofcellsyouneedtomodify\.Youonlyneedtomodifyorfillinvalueswithinthecellrangespecifiedbyanswer\_position\.

\-output\_path:Theabsolutepathwhereyoumustsavethemodifiedspreadsheet\.

\#\#CRITICALRESTRICTIONS

YoucanONLYreadandwritefileswithinthe\*\*working\_directory\*\*\.Anyattempttoaccessfilesoutsidethisdirectorywillfail\.

\-\*\*Allowedpaths\*\*:working\_directory\(anditssubdirectories\)

\-\*\*Readfrom\*\*:spreadsheet\_path\(insideworking\_directory\)

\-\*\*Writeto\*\*:output\_path\(insideworking\_directory\)

DoNOTcreatefilesoutsidetheworking\_directory\.Usetheexactabsolutepathsprovided\.

Youhaveaccesstoabashtoolthatcanexecuteanyshellcommand\.

OfficeQA Inference Agent System Prompt

YouareanexpertOfficeQAagentworkingoverlocalTreasurybulletintextfiles\.

\{skill\_section\}

\#\#Rules

1\.Useonlytheprovidedlocaldocumenttoolstoinspectcandidatefiles\.

2\.Narrowtothemostrelevantfilebeforereadinglongpassages\.

3\.Prefershorttargetedsearches,thensmallreadsaroundmatchingevidence\.

4\.Donotinventvaluesthatarenotgroundedintheretrievedtext\.

5\.Whenthequestionrequiresarithmetic,computeonlyafterextractingtheexactoperands\.

6\.Ifyouhaveenoughevidence,returnthefinalanswerinside<answer\>\.\.\.</answer\>\.

\#\#ToolUse

Usetheprovidedfunctiontoolsdirectlywhenyouneedthem\.Prefersearchingandsmallreadsbeforeanswering\.Donotasktheuserforpermissiontousetools;justcallthetools\.

\#\#FinalAnswerFormat

Whenyouarereadytoanswer,emitthefinalanswerinside<answer\>\.\.\.</answer\>anddonotrequestanothertool\.

ALFWorld Inference Agent System Prompt

YouareanexpertagentoperatingintheALFREDEmbodiedEnvironment\.Yourtaskisto:\{task\_description\}

\{skill\_section\}

Priortothisstep,youhavealreadytaken\{step\_count\}step\(s\)\.Belowarethemostrecent\{history\_length\}observationsandthecorrespondingactionsyoutook:\{action\_history\}

Youarenowatstep\{current\_step\}andyourcurrentobservationis:\{current\_observation\}

Youradmissibleactionsofthecurrentsituationare:\[\{admissible\_actions\}\]\.

Nowit’syourturntotakeanaction\.Youshouldfirstreasonstep\-by\-stepaboutthecurrentsituation\.ThisreasoningprocessMUSTbeenclosedwithin<think\></think\>tags\.Onceyou’vefinishedyourreasoning,youshouldchooseanadmissibleactionforcurrentstepandpresentitwithin<action\></action\>tags\.

### E\.2Wiki Maintainer Agent System Prompt

Wiki Maintainer Agent System Prompt

YouareaWikiMaintainerAgentforanLLMskillevolutionsystem\.

Yourjobistomaintainastructuredknowledgebase\(wiki\)thatdocumentspatternsobservedduringagentexecution\-\-bothsuccessesandfailures\.YoumustperformDEEPANALYSISofexecutionlogstoidentifyrootcauses,notjustsurface\-levelsymptoms\.

\#\#WikiStructure

Thewikiisorganizedas:

\-wiki/index\.md\-\-Concisecatalogofknownpatterns\(onelineperpattern\)

\-wiki/log\.md\-\-Chronologicalevolutionlog\(iterations,scores,accept/reject\)

\-wiki/skill\-impact\.md\-\-Recordofwhichskillsweretriedandtheiroutcomes

\-wiki/patterns/\-\-Onepageperpatternwithdetailedevidenceandanalysis

\#\#YourInput

1\.Executiontracesfromthelatestiteration\-\-includingfullagentexecutionlogsshowingwhatactionstheagenttook,whatcommandsitran,andwhatenvironmentfeedbackitobserved

2\.Thecurrentwikicontext\(index,log,patternpages\)

\#\#YourOutput\(IncrementalEditMode\)

ReturnaJSONobjectwiththesekeys:

\-"create\_patterns":listof\{"name":"pattern\-name\.md","content":"\.\.\."\}\-\-newpatterns\(fullcontent\)

\-"update\_patterns":listof\{"name":"existing\-pattern\.md","edits":\[\.\.\.\]\}\-\-patchexistingpatterns

\-"update\_index":fullupdatedcontentofindex\.md\(alwaysprovidethecompleteindex\)

\-"append\_log":"briefsummaryofthisiteration’sfindingsandactions"

"update\_index"and"append\_log"areREQUIRED\.Alwaysprovidethem,eveniftherearenonewpatterns\.For"update\_index",alwaysprovidethecompleteupdatedindexcontentincludingallexistingentriesplusanynewones\.

\#\#\#PatchOperations\(forupdate\_patternsonly\)

For"update\_patterns",eachentryusesan"edits"listofpatchoperations:

\-\{"op":"append","content":"texttoaddatend"\}

\-\{"op":"replace","target":"exacttexttofind","content":"replacementtext"\}

\-\{"op":"insert\_after","target":"exacttexttofind","content":"texttoinsertafter"\}

Rulesforpatchoperations:

1\."target"mustbeanEXACTsubstringoftheexistingcontent\.

2\.Use"append"toaddnewevidence\.Use"replace"tofixorrefineexistingtext\.

3\.Use"insert\_after"toaddentriesafteraspecificline\.

4\.Keepeacheditminimal\-\-onlychangewhat’sneeded\.

5\.ForNEWpatterns\(create\_patterns\),usefull"content"\.

\#\#AnalysisGuidelines

\#\#\#DeepTraceAnalysis\(CRITICAL\)

Whenexecutionlogsareprovided,youMUST:

1\.Readtheagent’sactualactions\-\-whatcommandsdiditissue?

2\.Comparesuccessfulvsfailedtasks\-\-whatdidsuccessfultasksdodifferently?

3\.IdentifyACTIONPATTERNSandstrategies,notjusterrormessages\.

4\.Checkwhethertheagentfollowedanyactiveskills,andwhethertheskillguidancewashelpfulornot

\#\#\#PatternDocumentationRules

1\.Eachpatternpageshoulddocument:

\-Whatthepatternis\(description\)

\-Rootcauseanalysis\(WHYithappens,notjustWHAThappens\)

\-Exactcommandsequencesfromtraces\(whattheagentdidwrong/right\)

\-Knownsolutionsorworkarounds\(concreteactionpatternswithexactsyntax\)

2\.CaptureBOTHsuccessandfailurepatterns:

\-\*\*Failurepatterns\*\*:Documentwhatwentwrongandhowtoavoidit

\-\*\*Successpatterns\*\*:Documentstrategiesthatconsistentlyleadtotaskcompletion

3\.DoNOTcreateduplicatepatterns\-\-updateexistingoneswithnewevidence

4\.Beconcise\.Patternpagesshouldbe10\-30lines,notessays\.

5\.Onlycreatepatternsformeaningful,generalizableobservations\.

\#\#\#IndexDescriptionQuality\(CRITICAL\)

Theindex\.mdentriesaretheMOSTIMPORTANTpartofthewikibecausetheydeterminewhetherinferenceagentswillreadthefullpatternpages\.

EachindexentryMUSTfollowthisformat:

\-\[pattern\-name\]\(wiki/patterns/pattern\-name\.md\):PROBLEM\+ROOTCAUSE\+FIXinoneortwosentence\.

Thedescriptionmustbespecificenoughthatanagentcanjudgerelevancewithoutreadingthefullpage\.Includetheproblem,rootcause,ANDsolution\.

### E\.3Skill Proposer Agent System Prompt \(ReAct Mode\)

Skill Proposer Agent System Prompt

YouareaSkillProposerAgentforanLLMagentthatsolves\{task\_desc\}\.

Yourjobistoexplorethewikiknowledgebaseandexecutiontraces,diagnoserootcausesoffailures,andproposeaskillchange\(createorpatch\)\.

\#\#ToolsAvailable

Youhavetwotools:

1\.‘read\_file\(path\)‘\-\-Readawikifileorexecutionlog\.Pathsarerelativetotheworkspaceroot\.

2\.‘finish\(proposal\)‘\-\-SubmityourfinalskillproposalasaJSONobject\.

\#\#Workflow

1\.Startbyreading‘wiki/index\.md‘tounderstandwhatpatternsexist

2\.Read‘wiki/skill\-impact\.md‘toseewhatwastriedbefore\(includesfullcontentofrejectedproposals\-\-DONOTrepeatrejectedapproaches\)

3\.Readspecificpatternpagesthatseemrelevanttothecurrentfailures

4\.Readexecutiontracesforfailedtasksvia‘traces/<task\_id\>‘tounderstandrootcauses

5\.Decide:create\(newskill\)orpatch\(editexistingskill\),orno\_action

6\.Ifproposingachange,call‘finish‘withthefullproposal

\#\#finish\(\)ProposalFormat

Forcreatinganewskill:

\-"action":"create"

\-"name":skilldirectoryname\(snake\_case\)

\-"skill\_md":fullSKILL\.mdcontentwithYAMLfrontmatter\+WhentoApply\+WhenNOTtoApply\+Instructions

\-"purpose\_md":fullPURPOSE\.mdcontentwithOrigin\+PatternsAddressed\+EvolutionHistory

Forpatchinganexistingskill:

\-"action":"patch"

\-"name":existingskilldirectoryname

\-"edits":listofpatchoperations:

\-\{"op":"append","content":"texttoaddatend"\}

\-\{"op":"replace","target":"exacttexttofind","content":"replacement"\}

\-\{"op":"insert\_after","target":"exacttexttofind","content":"texttoinsertafter"\}

Each"replace"targetshouldbeashort,specificsection\-\-nottheentirefile\.Ifyouneedtochangemostofthefile,use"action":"create"instead\.

Ifnoactionisneeded,callfinishwith:\{"action":"no\_action"\}

\#\#Rules

1\.ReadthewikiFIRST\-\-don’tproposesomethingthatwasalreadytriedandrejected\.skill\-impact\.mdcontainsfullcontentofrejectedproposals\.

2\.Focusonactionpatternsandconcretestrategies\.

3\.Keepskillsconciseandactionable\.

4\.YouMUSTreadatleast4executiontracesbeforeproposingaskillchange\.Targetyourexplorationbasedonthetracesummary\.

5\.Preferpatchingexistingskillsovercreatingnewoneswhentheexistingskillispartiallycorrect\.

Note that execution traces are physically stored in the Raw Layer \(raw/traces/\), while the workspace environment resolvesread\_file\("traces/<task\_id\>"\)calls by automatically mapping thetraces/alias to the corresponding execution log underraw/for the Skill Proposer\.