DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution

arXiv cs.CL 论文

摘要

The paper introduces DIVE, a diversity-driven framework that enables frozen LLMs to self-improve by evolving persistent natural-language skills from task experience and verifier feedback, without parameter updates. It outperforms existing methods on math and logical reasoning tasks and transfers across model scales.

arXiv:2608.12486v1 Announce Type: new Abstract: Large language models (LLMs) cannot retain post-deployment experience without parameter updates. We introduce DIVE, a diversity-driven framework that enables frozen LLMs to improve by evolving persistent natural-language skills from task experience and verifier feedback. These skills encode reusable reasoning procedures, verification strategies, common failure modes, and output constraints and are both executed and revised by the same underlying model without access to a teacher model. Since natural-language skill evolution is a stochastic, non-convex search process, optimizing a single skill trajectory can overfit to sampled experience or converge to a suboptimal solution. DIVE mitigates this optimization variance by independently evolving multiple skill populations from bootstrapped experience, adaptively refining them through diverse transformations, and jointly selecting a complementary set of skills. Across six mathematical and logical reasoning tasks and multiple model families, DIVE consistently outperforms existing reasoning methods, prompt-optimization approaches, skill-development frameworks, and memory-based baselines. It achieves rapid self-improvement from accumulated experience, obtaining substantially larger performance gains with fewer rollouts than parameter-based methods such as SFT and GRPO, and prompt optimization with GEPA. Further, the resulting skills transfer across model scales and families, enabling smaller models such as GPT-5-nano to match or outperform larger counterparts, i.e., GPT-5, under conventional prompting. These results establish diversity-driven skill evolution as an effective, interpretable, and parameter-free approach to LLM self-improvement.
查看原文
查看缓存全文

缓存时间: 2026/08/14 09:26

# DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution
Source: [https://arxiv.org/html/2608.12486](https://arxiv.org/html/2608.12486)
###### Abstract

Large language models \(LLMs\) cannot retain post\-deployment experience without parameter updates\. We introduceDIVE, a diversity\-driven framework that enables frozen LLMs to improve by evolving persistent natural\-language skills from task experience and verifier feedback\. These skills encode reusable reasoning procedures, verification strategies, common failure modes, and output constraints and are both executed and revised by the same underlying model without access to a teacher model\. Since natural\-language skill evolution is a stochastic, non\-convex search process, optimizing a single skill trajectory can overfit to sampled experience or converge to a suboptimal solution\.DIVEmitigates this optimization variance by independently evolving multiple skill populations from bootstrapped experience, adaptively refining them through diverse transformations, and jointly selecting a complementary set of skills\. Across six mathematical and logical reasoning tasks and multiple model families,DIVEconsistently outperforms existing reasoning methods, prompt\-optimization approaches, skill\-development frameworks, and memory\-based baselines\. It achieves rapid self\-improvement from accumulated experience, obtaining substantially larger performance gains with fewer rollouts than parameter\-based methods such as SFT and GRPO, and prompt optimization with GEPA\. Further, the resulting skills transfer across model scales and families, enabling smaller models such as GPT\-5\-nano to match or outperform larger counterparts, i\.e\., GPT\-5, under conventional prompting\. These results establish diversity\-driven skill evolution as an effective, interpretable, and parameter\-free approach to LLM self\-improvement\.

## Introduction

Large language models \(LLMs\) exhibit broad reasoning capabilities\([49](https://arxiv.org/html/2608.12486#bib.bib54);[50](https://arxiv.org/html/2608.12486#bib.bib56);[41](https://arxiv.org/html/2608.12486#bib.bib55);[53](https://arxiv.org/html/2608.12486#bib.bib53);[3](https://arxiv.org/html/2608.12486#bib.bib61);[39](https://arxiv.org/html/2608.12486#bib.bib51);[40](https://arxiv.org/html/2608.12486#bib.bib50)\), yet their behavior after deployment is largely static\. When a model repeatedly encounters examples from a task, receives feedback, or discovers a useful solution strategy, that experience does not modify its parameters or automatically persist across future queries\. Fine\-tuning can internalize such experience, but it requires access to model weights, substantial computation, and a carefully designed training pipeline\. These requirements are increasingly restrictive as many capable language models are accessible only through APIs or deployed under limited adaptation budgets\. This motivates a complementary question:*can a frozen language model achieve self\-improvement by converting experience into persistent natural\-language skills?*

\(a\)HMMT, Qwen3\-8B\(b\)Sudoku, Qwen3\-8B
Figure 1:Optimization efficiency on HMMT and Sudoku using Qwen3\-8B\.DIVEenables rapid self\-improvement from accumulated experience, achieving substantially larger performance gains with fewer rollouts than parameter\-based optimization \(SFT, GRPO\) and prompt optimization \(GEPA\)\.Prior work on textual reflection and prompt optimization suggests that natural\-language context can serve as a writable substrate through adapting frozen language models\([29](https://arxiv.org/html/2608.12486#bib.bib18);[24](https://arxiv.org/html/2608.12486#bib.bib5);[2](https://arxiv.org/html/2608.12486#bib.bib1)\)\. Reliable self\-improvement, however, requires more than generating a better prompt\. We consider the challenging setting in which the same frozen model must solve the task, interpret verifier feedback, and revise its own knowledge without access to a stronger teacher\. This setting raises three key challenges\. First, self\-generated revisions are inherently noisy: a locally beneficial edit may remove useful guidance, overfit to a small set of failures, or amplify an incorrect reflection, making greedy single\-candidate refinement brittle\. Second, accumulated experience quickly exceeds the context budget, requiring demonstrations, traces, and feedback to be distilled into compact, reusable abstractions rather than appended indefinitely\([43](https://arxiv.org/html/2608.12486#bib.bib49);[37](https://arxiv.org/html/2608.12486#bib.bib47)\)\. Third, skill evolution is path\-dependent: different initial skills, sampled experiences, and revision trajectories can lead to substantially different solutions\. Maintaining only a single evolving trajectory can therefore prematurely discard promising alternatives or converge to a suboptimal solution\. Effective self\-improvement therefore requires preserving diverse solution trajectories throughout skill evolution\.

We introduceDIVE, a diversity\-driven framework for self\-improvement of frozen LLMs through natural\-language skill evolution\.DIVErepresents accumulated experience as persistent skills that encode reusable reasoning procedures, verification strategies, common failure modes, and output constraints\. The same LLM both executes and revises these skills using task experience and verifier feedback, while its parameters remain fixed throughout optimization\.

The central principle ofDIVEis to preserve diversity throughout skill evolution and exploit the resulting complementarity at inference time\. Rather than refining a single incumbent skill,DIVEindependently evolves multiple skill populations from bootstrapped experience\. Within each population, a portfolio of heterogeneous evolution operators, including Reflective Repair, Exploratory Revision, Compression, and Multi\-Parent Recombination, proposes alternative revisions\. An upper\-confidence\-bound policy adaptively allocates proposal budget across these operators based on their observed utility, while new operators can be generated from accumulated evolution history\.

After evolution, candidate skills from all populations are evaluated on a shared validation set and jointly selected to form a compact, complementary skill set\. At inference time, the selected skills independently generate candidate solutions, which are ranked by the frozen model to select the final response\. In this way,DIVEuses diversity both to reduce the brittleness of textual skill optimization and to improve the reliability of downstream predictions through complementary skill hypotheses\.

Unlike prior prompt optimization that primarily searches for a single improved prompt,DIVEmaintains and evolves multiple skill hypotheses through independent populations, adaptive transformation operators, and joint skill selection\. We evaluateDIVEacross six mathematical and logical reasoning tasks and multiple model families\.DIVEconsistently improves held\-out performance without parameter updates, outperforming inference\-time reasoning, skill\-learning, memory\-based, and prompt\-optimization baselines\. Ablations further demonstrate the complementary benefits of the key design components\.

Our main contributions are:

- •We formulate self\-improvement of frozen LLMs as the evolution of persistent natural\-language skills, enabling models to accumulate reusable task knowledge from experience and verifier feedback without weight updates or a stronger teacher model\.
- •We introduceDIVE, a diversity\-driven framework that independently evolves multiple skill populations from bootstrapped experience and adaptively allocates the evolution budget across heterogeneous transformation operators, preserving diverse skill hypotheses and evolution trajectories\.
- •We jointly select a complementary set of skills, translating diversity in the evolution process into improved held\-out performance\. Experiments across diverse reasoning tasks and model families further demonstrate effective self\-improvement and cross\-model skill transfer\.

![Refer to caption](https://arxiv.org/html/2608.12486v1/Framework.png)Figure 2:Overview ofDIVE\. We construct multiple independent skill populations from bootstrapped experience, evolve each population using adaptively selected operators, and jointly select complementary skills as the final skill set\.
## Preliminaries

### Problem Definition

Given a questionxx, a language modelfθf\_\{\\theta\}produces a responsefθ​\(x\)f\_\{\\theta\}\(x\)\. An external verifier with access to the gold answeryyevaluates the response and returns a binary score

r⁡\(x,y,fθ​\(x\)\)∈\{0,1\},r\(x,y,f\_\{\\theta\}\(x\)\)\\in\\\{0,1\\\},\(1\)wherer=1r=1indicates a correct response andr=0r=0otherwise\. Depending on the task, the verifier may additionally return structured diagnostic signals, such as format violations, execution failures, or timeouts\. Importantly, the verifier does NOT provide natural\-language critiques\.

For a task distribution𝒯\\mathcal\{T\}over question–answer pairs\(x,y\)\(x,y\), we define the performance of the frozen model as

V𝒯​\(fθ\)=𝔼\(x,y\)∼𝒯​\[r⁡\(x,y,fθ​\(x\)\)\]\.V\_\{\\mathcal\{T\}\}\(f\_\{\\theta\}\)=\\mathbb\{E\}\_\{\(x,y\)\\sim\\mathcal\{T\}\}\\left\[r\\left\(x,y,f\_\{\\theta\}\(x\)\\right\)\\right\]\.\(2\)Our goal is to improve task performance while keeping the model parametersθ\\thetafixed\.

### Skill\-Based Self\-Improvement of Frozen LLMs

To achieve this goal, the model must accumulate and reuse task\-specific knowledge from experience and verifier feedback\. We represent this acquired knowledge as a natural\-language skillss\. A skill is a compact textual artifact that guides subsequent inference by encoding reusable reasoning procedures, verification strategies, common failure modes, and output constraints\. The performance of a skillsson task distribution𝒯\\mathcal\{T\}is

V𝒯​\(s\)=𝔼\(x,y\)∼𝒯​\[r⁡\(x,y,fθ​\(x,s\)\)\],V\_\{\\mathcal\{T\}\}\(s\)=\\mathbb\{E\}\_\{\(x,y\)\\sim\\mathcal\{T\}\}\\left\[r\(x,y,f\_\{\\theta\}\(x;s\)\)\\right\],\(3\)wherefθ​\(x,s\)f\_\{\\theta\}\(x;s\)denotes the response generated by the frozen model conditioned on skillss\.

Given a dataset𝒟\\mathcal\{D\}and a skillss, we denote by

ℰ⁡\(𝒟,s\)=\{\(x,fθ​\(x,s\),r⁡\(x,y,fθ​\(x,s\)\)\)\}\(x,y\)∈𝒟\\mathcal\{E\}\(\\mathcal\{D\};s\)=\\\{\(x,f\_\{\\theta\}\(x;s\),r\(x,y,f\_\{\\theta\}\(x;s\)\)\)\\\}\_\{\(x,y\)\\in\\mathcal\{D\}\}\(4\)the set of verifier\-labeled skill\-conditioned trajectories \(we analogously writeℰ⁡\(𝒟\)\\mathcal\{E\}\(\\mathcal\{D\}\)as zero\-shot trajectories\); the same model proposes a revised skill as

s′=UpdateSkillfθ⁡\(s,ℰ⁡\(𝒟,s\)\)\.s^\{\\prime\}=\\operatorname\{UpdateSkill\}\_\{f\_\{\\theta\}\}\(s,\\mathcal\{E\}\(\\mathcal\{D\};s\)\)\.\(5\)Compared with weight\-space self\-improvement, this setting remains applicable when model weights or training infrastructure are unavailable, as is often the case for proprietary models\. Moreover, the resulting skills are human\-readable, editable, reversible, and transferable across models\.

## Methodology

### Overview

We introduceDIVE, a framework that improves a frozen language model by evolving multiple skills and jointly selecting a complementary set of skills\. Skill evolution is a stochastic, non\-convex search process in which different initializations, sampled examples, and revision trajectories can produce substantially different solutions\.DIVEtherefore preserves multiple independent evolution trajectories and exploits their complementary strengths rather than relying on a single optimization run\.

Specifically, we first partition the development data into an evolution set𝒟evo\\mathcal\{D\}\_\{\\mathrm\{evo\}\}and a validation set𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}, while reserving𝒟test\\mathcal\{D\}\_\{\\mathrm\{test\}\}exclusively for final evaluation\. We then constructKKindependent skill populations from bootstrapped subsets of𝒟evo\\mathcal\{D\}\_\{\\mathrm\{evo\}\}\. Each population is evolved using a portfolio of heterogeneous evolution operators whose proposal budget is adaptively allocated via upper confidence bounds\. After evolution, all candidate skills are evaluated on the shared validation set, from which we jointly construct a complementary final skill set\. At inference time, the selected skills independently generate candidate solutions, which are ranked by the frozen model to select the final response\.Additional methodology details and theoretical analysis are provided in the supplementary material\.

### Independent Skill Population Construction

For each populationk∈\[K\]k\\in\[K\], we independently sample a bootstrapped experience subset𝒟exp\(k\)\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\}and a bootstrapped reflection subset𝒟ref\(k\)\\mathcal\{D\}\_\{\\mathrm\{ref\}\}^\{\(k\)\}from𝒟evo\\mathcal\{D\}\_\{\\mathrm\{evo\}\}\. The two subsets serve distinct roles\. The experience subset provides verifier\-labeled trajectories from which reusable task knowledge is extracted, while the reflection subset is used to evaluate candidate skills, diagnose failures, and guide subsequent revisions\. Together with an evolution budgetBB, these subsets define thekk\-th evolved population:

𝒮B\(k\)=DevelopSkillfθ⁡\(𝒟exp\(k\),𝒟ref\(k\)\)\.\\mathcal\{S\}\_\{B\}^\{\(k\)\}=\\operatorname\{DevelopSkill\}\_\{f\_\{\\theta\}\}\\left\(\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\},\\mathcal\{D\}\_\{\\mathrm\{ref\}\}^\{\(k\)\}\\right\)\.\(6\)Although all populations optimize the same task objective, their distinct bootstrapped subsets and evolution trajectories encourage the emergence of different reasoning procedures and verification strategies\.

#### Seed Skill Initialization\.

For each populationkk, we construct an initial seed set𝒮0\(k\)\\mathcal\{S\}^\{\(k\)\}\_\{0\}by distilling reusable task knowledge from the verifier\-labeled trajectories collected on𝒟exp\(k\)\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\}:

𝒮0\(k\)=InitializeSkillfθ⁡\(ℰ⁡\(𝒟exp\(k\)\)\)\.\\mathcal\{S\}^\{\(k\)\}\_\{0\}=\\operatorname\{InitializeSkill\}\_\{f\_\{\\theta\}\}\\left\(\\mathcal\{E\}\(\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\}\)\\right\)\.\(7\)The resulting seeds capture complementary aspects of the experience, including successful reasoning patterns, verification strategies, recurring failure modes, and output constraints, yielding an initial population with diverse inductive biases\.

### Adaptive Skill Evolution

Each skill population is evolved independently\. For clarity, we consider a single population and omit the population superscriptkkthroughout this subsection\. At each evolution steptt, the model uses verifier\-labeled trajectories from the corresponding reflection subset to evaluate current skills, diagnose their failures, and propose candidate revisions\.

Table 1:Performance comparison across mathematical and logical reasoning benchmarks\. All logical reasoning results are evaluated on the hard subsets of the corresponding benchmarks\. Best results for each model and benchmark are shown in bold\.#### Evolution Operators\.

An*evolution operator*is a structured transformation that proposes skill revisions and induces a particular*inductive bias*over the skill search space\. Relying on a single revision strategy may restrict the range of explored transformations and lead the search toward suboptimal solutions\. We therefore maintain a portfolio of*heterogeneous*operators that support complementary forms of skill evolution\.

At steptt, an operatorat∈𝒜a\_\{t\}\\in\\mathcal\{A\}is selected, followed by a corresponding parent set

𝒫t=SelectParents⁡\(𝒮t,at\)\.\\mathcal\{P\}\_\{t\}=\\operatorname\{SelectParents\}\\left\(\\mathcal\{S\}\_\{t\},a\_\{t\}\\right\)\.\(8\)The selected operator then defines a conditional proposal skill:

st′∼pfθ\(⋅∣𝒫t,ℰ\(𝒟ref;𝒫t\),at\),s^\{\\prime\}\_\{t\}\\sim p\_\{f\_\{\\theta\}\}\\left\(\\cdot\\mid\\mathcal\{P\}\_\{t\},\\mathcal\{E\}\(\\mathcal\{D\}\_\{\\mathrm\{ref\}\};\\mathcal\{P\}\_\{t\}\),a\_\{t\}\\right\),\(9\)where

ℰ⁡\(𝒟ref,𝒫t\)=⋃s∈𝒫tℰ⁡\(𝒟ref,s\)\\mathcal\{E\}\\left\(\\mathcal\{D\}\_\{\\mathrm\{ref\}\};\\mathcal\{P\}\_\{t\}\\right\)=\\bigcup\_\{s\\in\\mathcal\{P\}\_\{t\}\}\\mathcal\{E\}\\left\(\\mathcal\{D\}\_\{\\mathrm\{ref\}\};s\\right\)\(10\)collects the verifier\-labeled trajectories generated under the selected parent skills\. The operatorata\_\{t\}specifies the*proposal kernel*, thereby shaping the distribution over candidate revisions\.

Algorithm 1DIVE: Diversity\-Driven Skill Evolution0:Frozen model

fθf\_\{\\theta\}, evolution set

𝒟evo\\mathcal\{D\}\_\{\\mathrm\{evo\}\}, validation set

𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}, verifier

rr, evolution budget

BB, number of populations

KK, initial operators

𝒜0\\mathcal\{A\}\_\{0\}, UCB coefficient

β\\beta, operator\-generation step

tnewt\_\{\\mathrm\{new\}\}, number of new operators

NnewN\_\{\\mathrm\{new\}\}, maximum final skill\-set size

MM
0:Final skill set

𝒮final\\mathcal\{S\}\_\{\\mathrm\{final\}\}
1:

𝒞←∅\\mathcal\{C\}\\leftarrow\\emptyset
2:for

k=1,…,Kk=1,\\ldots,Kin paralleldo

3:Bootstrap

𝒟exp\(k\),𝒟ref\(k\)⊆𝒟evo\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\},\\mathcal\{D\}\_\{\\mathrm\{ref\}\}^\{\(k\)\}\\subseteq\\mathcal\{D\}\_\{\\mathrm\{evo\}\}
4:

𝒮0\(k\)←InitializeSkillfθ​\(ℰ⁡\(𝒟exp\(k\)\)\)\\mathcal\{S\}\_\{0\}^\{\(k\)\}\\leftarrow\\textsc\{InitializeSkill\}\_\{f\_\{\\theta\}\}\(\\mathcal\{E\}\(\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\}\)\)
5:

𝒜\(k\)←𝒜0\\mathcal\{A\}^\{\(k\)\}\\leftarrow\\mathcal\{A\}\_\{0\}
6:Initialize

\{Na,μ^a\}a∈𝒜\(k\)\\\{N\_\{a\},\\widehat\{\\mu\}\_\{a\}\\\}\_\{a\\in\\mathcal\{A\}^\{\(k\)\}\}
7:

ℋ\(k\)←∅\\mathcal\{H\}^\{\(k\)\}\\leftarrow\\emptyset
8:for

t=1,…,Bt=1,\\ldots,Bdo

9:ifsome

a∈𝒜\(k\)a\\in\\mathcal\{A\}^\{\(k\)\}has not been triedthen

10:

at←a\_\{t\}\\leftarrowan untried operator

11:else

12:

at←arg⁡maxa∈𝒜\(k\)⁡\[μ^a\+β​log⁡tNa\]a\_\{t\}\\leftarrow\\arg\\max\_\{a\\in\\mathcal\{A\}^\{\(k\)\}\}\\left\[\\widehat\{\\mu\}\_\{a\}\+\\beta\\sqrt\{\\frac\{\\log t\}\{N\_\{a\}\}\}\\right\]
13:endif

14:

𝒫t←SelectParents​\(𝒮t−1\(k\),at\)\\mathcal\{P\}\_\{t\}\\leftarrow\\textsc\{SelectParents\}\(\\mathcal\{S\}\_\{t\-1\}^\{\(k\)\},a\_\{t\}\)
15:

st′∼pfθ\(⋅∣𝒫t,ℰ\(𝒟ref\(k\);𝒫t\),at\)s^\{\\prime\}\_\{t\}\\sim p\_\{f\_\{\\theta\}\}\\left\(\\cdot\\mid\\mathcal\{P\}\_\{t\},\\mathcal\{E\}\(\\mathcal\{D\}\_\{\\mathrm\{ref\}\}^\{\(k\)\};\\mathcal\{P\}\_\{t\}\),a\_\{t\}\\right\)
16:Evaluate

st′s^\{\\prime\}\_\{t\}on

𝒟ref\(k\)\\mathcal\{D\}\_\{\\mathrm\{ref\}\}^\{\(k\)\}
17:

Rt←U⁡\(st′\)−maxs∈𝒫t⁡U⁡\(s\)R\_\{t\}\\leftarrow U\(s^\{\\prime\}\_\{t\}\)\-\\max\_\{s\\in\\mathcal\{P\}\_\{t\}\}U\(s\)
18:Update

NatN\_\{a\_\{t\}\}and

μ^at\\widehat\{\\mu\}\_\{a\_\{t\}\}using

RtR\_\{t\}
19:Update

ℋ\(k\)\\mathcal\{H\}^\{\(k\)\}with the current proposal and outcome

20:

𝒮t\(k\)←UpdatePopulation​\(𝒮t−1\(k\),st′\)\\mathcal\{S\}\_\{t\}^\{\(k\)\}\\leftarrow\\textsc\{UpdatePopulation\}\(\\mathcal\{S\}\_\{t\-1\}^\{\(k\)\},s^\{\\prime\}\_\{t\}\)
21:if

t=tnewt=t\_\{\\mathrm\{new\}\}then

22:

𝒜new\(k\)←GenerateOperatorfθ​\(ℋ\(k\),Nnew\)\\mathcal\{A\}^\{\(k\)\}\_\{\\mathrm\{new\}\}\\leftarrow\\textsc\{GenerateOperator\}\_\{f\_\{\\theta\}\}\(\\mathcal\{H\}^\{\(k\)\},N\_\{\\mathrm\{new\}\}\)
23:

𝒜\(k\)←𝒜\(k\)∪𝒜new\(k\)\\mathcal\{A\}^\{\(k\)\}\\leftarrow\\mathcal\{A\}^\{\(k\)\}\\cup\\mathcal\{A\}^\{\(k\)\}\_\{\\mathrm\{new\}\}
24:Initialize new operators as untried

25:endif

26:endfor

27:

𝒞←𝒞∪𝒮B\(k\)\\mathcal\{C\}\\leftarrow\\mathcal\{C\}\\cup\\mathcal\{S\}\_\{B\}^\{\(k\)\}
28:endfor

29:Evaluate all

s∈𝒞s\\in\\mathcal\{C\}on

𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}
30:

𝒮final←JointSelect​\(\{𝒮B\(k\)\}k=1K,𝒟val,M\)\\mathcal\{S\}\_\{\\mathrm\{final\}\}\\leftarrow\\textsc\{JointSelect\}\\left\(\\\{\\mathcal\{S\}^\{\(k\)\}\_\{B\}\\\}\_\{k=1\}^\{K\},\\mathcal\{D\}\_\{\\mathrm\{val\}\},M\\right\)
31:return

𝒮final\\mathcal\{S\}\_\{\\mathrm\{final\}\}

#### Adaptive Allocation with Upper Confidence Bounds\.

To adaptively allocate the evolution budget across operators, we balance exploitation and exploration using an upper\-confidence\-bound \(UCB\) score:

UCBa⁡\(t\)=μ^a​\(t\)\+β​log⁡tNa​\(t\),\\operatorname\{UCB\}\_\{a\}\(t\)=\\widehat\{\\mu\}\_\{a\}\(t\)\+\\beta\\sqrt\{\\frac\{\\log t\}\{N\_\{a\}\(t\)\}\},\(11\)whereNa​\(t\)N\_\{a\}\(t\)denotes the number of times operatoraahas been selected before steptt, and

μ^a\(t\)=1Na​\(t\)∑τ<t:aτ=aRτ\\widehat\{\\mu\}\_\{a\}\(t\)=\\frac\{1\}\{N\_\{a\}\(t\)\}\\sum\_\{\\tau<t:\\,a\_\{\\tau\}=a\}R\_\{\\tau\}\(12\)is its empirical mean parent\-relative reward\. Here,Rτ≜U⁡\(sτ′\)−maxs∈𝒫τ⁡U⁡\(s\)R\_\{\\tau\}\\triangleq U\(s^\{\\prime\}\_\{\\tau\}\)\-\\max\_\{s\\in\\mathcal\{P\}\_\{\\tau\}\}U\(s\)denotes the improvement of the proposed skill over its best\-performing parent at stepτ\\tau, whereU⁡\(s\)U\(s\)denotes the average correctness of skillss\. Each operator is applied at least once for initialization, after which we select

at=arg⁡maxa∈𝒜​UCBa⁡\(t\)\.a\_\{t\}=\\arg\\max\_\{a\\in\\mathcal\{A\}\}\\operatorname\{UCB\}\_\{a\}\(t\)\.\(13\)The first term favors operators that have yielded larger improvements, while the second encourages exploration of less frequently evaluated operators\. This mechanism adaptively concentrates the finite evolution budget on empirically productive transformations while continuing to explore under\-evaluated alternatives\.

#### Adaptive Operator Generation\.

Letℋt\{\\mathcal\{H\}\}\_\{t\}denote the evolution history accumulated up to steptt, including the selected operators, parent skills, proposed revisions, and their parent\-relative reward\. At a predefined steptnewt\_\{\\mathrm\{new\}\}, we use this history to generateNnewN\_\{\\mathrm\{new\}\}operators that target recurring failure patterns or transformations insufficiently addressed by the existing operator portfolio:

𝒜new=GenerateOperatorfθ⁡\(ℋtnew,Nnew\)\.\\mathcal\{A\}\_\{\\mathrm\{new\}\}=\\operatorname\{GenerateOperator\}\_\{f\_\{\\theta\}\}\\left\(\{\\mathcal\{H\}\}\_\{t\_\{\\mathrm\{new\}\}\},N\_\{\\mathrm\{new\}\}\\right\)\.\(14\)The newly generated operators are added to the operator pool as untried operators,𝒜←𝒜∪𝒜new\\mathcal\{A\}\\leftarrow\\mathcal\{A\}\\cup\\mathcal\{A\}\_\{\\mathrm\{new\}\}\. Subsequent proposals are allocated across both existing and newly generated operators using the same UCB rule\. This allows the operator portfolio itself to adapt in response to observed evolution dynamics\.

### Final Skill Set Construction

After independently evolving allKKpopulations, we evaluate their candidate skills on𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}\. The shared validation set is used only for final skill set construction and does not induce further within\-population revisions\.

#### Joint Skill Set Selection\.

We construct the final skill set jointly according to the validation performance of the candidate generation and ranking pipeline\([38](https://arxiv.org/html/2608.12486#bib.bib52);[42](https://arxiv.org/html/2608.12486#bib.bib6)\)\.

For a candidate skill set𝒮\\mathcal\{S\}, each skills∈𝒮s\\in\\mathcal\{S\}independently generates a candidate responseos​\(x\)=fθ​\(x,s\)o\_\{s\}\(x\)=f\_\{\\theta\}\(x;s\)\. Given the resulting candidate set𝒪𝒮​\(x\)=\{os​\(x\)\}s∈𝒮\\mathcal\{O\}\_\{\\mathcal\{S\}\}\(x\)=\\\{o\_\{s\}\(x\)\\\}\_\{s\\in\\mathcal\{S\}\}, the frozen model jointly evaluates the candidate solutions based on their reasoning, answer consistency, and adherence to task constraints, and selects the highest\-ranked response:

o^𝒮​\(x\)=SelectTopfθ⁡\(x,𝒪𝒮​\(x\)\)\.\\widehat\{o\}\_\{\\mathcal\{S\}\}\(x\)=\\operatorname\{SelectTop\}\_\{f\_\{\\theta\}\}\\left\(x,\\mathcal\{O\}\_\{\\mathcal\{S\}\}\(x\)\\right\)\.\(15\)
The empirical validation utility of a skill set is

V^𝒟val​\(𝒮\)=1\|𝒟val\|​∑\(x,y\)∈𝒟valr⁡\(x,y,o^𝒮​\(x\)\)\.\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\\left\(\\mathcal\{S\}\\right\)=\\frac\{1\}\{\|\\mathcal\{D\}\_\{\\mathrm\{val\}\}\|\}\\sum\_\{\(x,y\)\\in\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}r\\left\(x,y,\\widehat\{o\}\_\{\\mathcal\{S\}\}\(x\)\\right\)\.\(16\)
Given a maximum final\-set sizeMM, we optimize the following objective

max𝒮⁡V^𝒟val​\(𝒮\),\\max\_\{\\mathcal\{S\}\}\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\\left\(\\mathcal\{S\}\\right\),\(17\)subject to𝒮⊆⋃k=1K𝒮B\(k\)\\mathcal\{S\}\\subseteq\\bigcup\_\{k=1\}^\{K\}\\mathcal\{S\}\_\{B\}^\{\(k\)\},1≤\|𝒮\|≤M1\\leq\|\\mathcal\{S\}\|\\leq M, and\|𝒮∩𝒮B\(k\)\|≤1\|\\mathcal\{S\}\\cap\\mathcal\{S\}\_\{B\}^\{\(k\)\}\|\\leq 1for allk∈\[K\]k\\in\[K\]\. In practice, we first retain the top few candidates from each population according to their individual performance on𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}, and then greedily construct the final skill set𝒮final\\mathcal\{S\}\_\{\\mathrm\{final\}\}according to each candidate’s marginal improvement toV^𝒟val\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\.

#### Inference\-Time Candidate Ranking\.

At test time, every skill in𝒮final\\mathcal\{S\}\_\{\\mathrm\{final\}\}independently generates a candidate response\. The candidates are then ranked byfθf\_\{\\theta\}, and the highest\-ranked candidate is returned as the final response:

o^𝒮final​\(x\)=SelectTopfθ⁡\(x,\{fθ​\(x,s\)\}s∈𝒮final\)\.\\widehat\{o\}\_\{\\mathcal\{S\}\_\{\\mathrm\{final\}\}\}\(x\)=\\operatorname\{SelectTop\}\_\{f\_\{\\theta\}\}\\left\(x,\\left\\\{f\_\{\\theta\}\(x;s\)\\right\\\}\_\{s\\in\\mathcal\{S\}\_\{\\mathrm\{final\}\}\}\\right\)\.\(18\)The final skill set is fixed using𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}, and the same ranking procedure is used throughout test\-time evaluation\.

MethodCallsInput TokensOutput TokensCostHMMTEq\. TheoriesSudokuCrypt\.Calc\.Futo\.Avg\.GPT\-5\-nano \(Zero\-shot\)1\.0170\.119,609\.3$0\.00864\.356\.571\.720\.130\.470\.852\.3GPT\-5\-nano \(Few\-shot\)1\.04,966\.317,590\.2$0\.00763\.359\.577\.025\.526\.269\.153\.4GPT\-5\-nano \(DIVE\)10\.933,811\.2216,834\.2$0\.08882\.964\.596\.061\.584\.899\.281\.5GPT\-5 \(Zero\-shot\)1\.0170\.115,388\.5$0\.15471\.376\.581\.364\.570\.595\.076\.5GPT\-5 \(Few\-shot\)1\.04,966\.314,675\.0$0\.15375\.081\.589\.066\.072\.095\.079\.8

Table 2:Performance and per\-example inference cost of small\-model skill evolution compared with large\-model prompting\. All logical reasoning tasks are evaluated on the hard subsets\. ForDIVE, the final skill\-set size is capped atM=10M=10\.ModelMethodHMMTEq\. TheoriesSudokuCrypt\.Calc\.Futo\.Avg\.Qwen3\.5\-9BZero\-shot42\.546\.417\.422\.516\.920\.627\.2DIVE\(Skills from Qwen3\.5\-9B\)65\.068\.730\.045\.455\.375\.156\.6Qwen3\.5\-27BZero\-shot82\.565\.651\.550\.548\.359\.459\.6DIVE\(Skills from Qwen3\.5\-9B\)90\.285\.381\.479\.268\.582\.681\.2DIVE\(Skills from Qwen3\.5\-27B\)95\.290\.185\.382\.572\.690\.786\.1DeepSeek\-v4\-flashZero\-shot75\.843\.777\.070\.884\.691\.273\.9DIVE\(Skills from Qwen3\.5\-9B\)87\.386\.592\.393\.291\.892\.090\.5DIVE\(Skills from DeepSeek\-v4\-flash\)93\.391\.599\.199\.097\.997\.896\.4

Table 3:Cross\-model transferability of evolved skills across model scales and families\. All logical reasoning results are evaluated on the hard subsets\. ForDIVE, the final skill\-set size is capped atM=10M=10\.

## Evaluation

We partition each dataset into evolution, validation, and test splits\. The optimizer has access to the inputs and labels in the evolution split, which are used for skill initialization and optimization\. The validation split is used only to evaluate candidate skills and construct the final skill set; its instances are never included in skill\-generation or revision prompts\. The test split remains strictly held out and is used only for final evaluation\. We evaluateDIVEon six mathematical and logical reasoning tasks: HMMT\([9](https://arxiv.org/html/2608.12486#bib.bib12)\), Equational Theories\([6](https://arxiv.org/html/2608.12486#bib.bib13)\), Sudoku, Cryptarithm, Calcudoku, and Futoshiki\([20](https://arxiv.org/html/2608.12486#bib.bib14)\)\. Experiments use GPT\-5\-nano\([30](https://arxiv.org/html/2608.12486#bib.bib11)\), DeepSeek\-v4\-flash\([44](https://arxiv.org/html/2608.12486#bib.bib10)\), and Qwen3\.5\([32](https://arxiv.org/html/2608.12486#bib.bib9)\)under standardized inference settings\. We compare against standard prompting and inference\-time reasoning methods, including in\-context learning \(ICL\)\([7](https://arxiv.org/html/2608.12486#bib.bib16)\), Self\-Consistency \(SC\)\([33](https://arxiv.org/html/2608.12486#bib.bib2)\), and Tree\-of\-Thought \(ToT\)\([52](https://arxiv.org/html/2608.12486#bib.bib3)\); experience\- and memory\-based methods, including Experience RAG\([18](https://arxiv.org/html/2608.12486#bib.bib15)\)and ExpeL\([58](https://arxiv.org/html/2608.12486#bib.bib4)\); skill\-learning methods, including Direct Skill Generation and SkillOpt\([48](https://arxiv.org/html/2608.12486#bib.bib46)\); and prompt\-optimization methods, including MIPROv2\([24](https://arxiv.org/html/2608.12486#bib.bib5)\)and GEPA\([2](https://arxiv.org/html/2608.12486#bib.bib1)\)\. We further compare against parameter\-based adaptation using SFT and GRPO\([27](https://arxiv.org/html/2608.12486#bib.bib7)\)on Qwen3\-8B\([46](https://arxiv.org/html/2608.12486#bib.bib8)\)\. Additional details on benchmarks and experimental settings are provided in the supplementary material\.

#### Main Results\.

[Table1](https://arxiv.org/html/2608.12486#Sx3.T1)summarizes the main results\. Across model families and both mathematical and logical reasoning tasks,DIVEconsistently achieves strong performance without parameter updates\.DIVEalso substantially outperforms experience\- and memory\-based methods and prompt optimization, showing the benefit of iterative skill evolution over one\-shot skill construction and single\-trajectory prompt optimization\. These results support the value of maintaining diverse evolution trajectories, heterogeneous revision strategies, and complementary skill hypotheses throughout the self\-improvement process\.

\(a\)HMMT, Qwen3\-8B\(b\)Sudoku, Qwen3\-8B
Figure 3:Ablation of the final skill set size on HMMT and Sudoku using Qwen3\-8B, with the number of skill populations fixed atK=10K=10\. Performance generally improves as more skills are included and gradually saturates\.
\(c\)HMMT, Qwen3\-8B\(d\)Sudoku, Qwen3\-8B
Figure 4:Ablation of the skill\-evolution strategy on HMMT and Sudoku using Qwen3\-8B\. We compare the best single evolution operator, multiple operators with uniform or UCB\-based allocation, and the full method with operator generation\.

Table 4:Ablation of skill\-set construction strategies using Qwen3\.5\-9B\. GivenK=10K=10populations and a maximum size ofM=10M=10,RandomMMSkillsrandomly selects one skill from each population, whileTop\-MMIndividual Skillsselects the individually best\-performing skills\.JointMM\-Skill Selectiondenotes our proposed strategy\. Logical reasoning uses hard subsets\.
#### Small Models with Skills vs\. Large Models\.

We show that GPT\-5\-nano withDIVEachieves higher average performance than GPT\-5 with ICL, while reducing inference cost by 42\.5% \([Table2](https://arxiv.org/html/2608.12486#Sx3.T2)\)\. Skill evolution can substantially enhance the reasoning performance of a smaller model, enabling it to rival a stronger model under conventional prompting without parameter updates and at lower inference cost\.

#### Optimization Efficiency\.

[Figure1](https://arxiv.org/html/2608.12486#Sx1.F1)compares the optimization dynamics ofDIVE, SFT, GRPO, and GEPA as a function of the number of rollouts on Qwen3\-8B\.DIVEimproves rapidly with additional experience, while SFT and GEPA plateau at substantially lower performance and GRPO improves more gradually despite requiring considerably more rollouts\. These results demonstrate a favorable performance–rollout trade\-off, withDIVEattaining higher accuracy using substantially fewer rollouts than competing optimization approaches\.

#### Cross\-Model Skill Transfer\.

As shown in[Table3](https://arxiv.org/html/2608.12486#Sx3.T3), skills developed for Qwen3\.5\-9B transfer effectively to both Qwen3\.5\-27B, a larger model in the same family, and DeepSeek\-v4\-flash, a model from a different family\. These results show that evolved skills encode reusable task\-solving knowledge that transfers across model scales and families, while target\-specific evolution provides further gains by adapting skills to the behavior of the target model\.

#### Ablation Analysis\.

[Figure4](https://arxiv.org/html/2608.12486#Sx4.F4)and[Figure4](https://arxiv.org/html/2608.12486#Sx4.F4)validate the key design choices ofDIVE\. Increasing the number of selected skills improves performance with diminishing returns, highlighting the benefit of complementary skill hypotheses, while heterogeneous operators outperform a single operator, UCB improves over uniform allocation, and adaptive operator generation yields further gains\. As shown in[Table4](https://arxiv.org/html/2608.12486#Sx4.T4), jointly selecting complementary skills achieves the strongest overall performance, outperforming random or individually ranked skill selection\.

## Related Work

Self\-Improvement of Language Models\.Language models can improve from experience through parameter updates such as supervised fine\-tuning, reinforcement learning, and preference optimization\([54](https://arxiv.org/html/2608.12486#bib.bib19);[12](https://arxiv.org/html/2608.12486#bib.bib21);[31](https://arxiv.org/html/2608.12486#bib.bib20);[36](https://arxiv.org/html/2608.12486#bib.bib62);[14](https://arxiv.org/html/2608.12486#bib.bib17);[63](https://arxiv.org/html/2608.12486#bib.bib40);[56](https://arxiv.org/html/2608.12486#bib.bib58);[4](https://arxiv.org/html/2608.12486#bib.bib60)\)\. While effective, weight\-space adaptation requires access to model parameters and training infrastructure and may incur substantial optimization cost\. Training\-free alternatives instead improve model behavior through self\-reflection and iterative refinement\([29](https://arxiv.org/html/2608.12486#bib.bib18);[21](https://arxiv.org/html/2608.12486#bib.bib22);[5](https://arxiv.org/html/2608.12486#bib.bib63)\), in\-context learning from interaction and feedback\([22](https://arxiv.org/html/2608.12486#bib.bib27);[45](https://arxiv.org/html/2608.12486#bib.bib28)\), and natural\-language reinforcement learning\([10](https://arxiv.org/html/2608.12486#bib.bib29)\)\. These approaches primarily refine individual responses, retain interaction histories or reflections in context or memory, or study learning from richer language feedback\. In contrast,DIVEconverts verifier\-labeled experience into persistent task\-level skills that explicitly encode reusable procedural knowledge, and optimizes multiple independent skill populations for reuse across future instances\.

Prompt Optimization and Evolution\.Automatic prompt optimization\([62](https://arxiv.org/html/2608.12486#bib.bib23);[11](https://arxiv.org/html/2608.12486#bib.bib25);[1](https://arxiv.org/html/2608.12486#bib.bib38);[47](https://arxiv.org/html/2608.12486#bib.bib24)\)uses language models to search for effective instructions rather than relying on manual prompt design\. Evolutionary approaches extend this paradigm in different directions: EvoPrompt\([15](https://arxiv.org/html/2608.12486#bib.bib26)\)evolves prompt populations, Rainbow Teaming\([26](https://arxiv.org/html/2608.12486#bib.bib37)\)generates adversarial prompts, and AlphaEvolve\([23](https://arxiv.org/html/2608.12486#bib.bib39)\)applies evolutionary search to algorithm and code optimization, and Pathwise\([13](https://arxiv.org/html/2608.12486#bib.bib48)\)uses self\-evolving LLMs for automated heuristic design\. More closely related to prompt optimization, GEPA\([2](https://arxiv.org/html/2608.12486#bib.bib1)\)combines natural\-language reflection with Pareto\-based candidate selection for evolutionary prompt optimization, while MAPRO\([55](https://arxiv.org/html/2608.12486#bib.bib57)\)formulates multi\-agent prompt optimization as structured probabilistic inference with feedback\-driven prompt refinement\.DIVEdiffers in how diversity is used throughout optimization\. Rather than using population diversity primarily to search for strong individual artifacts,DIVE*preserves diversity as an end\-to\-end design principle*, from independently bootstrapped evolution trajectories and heterogeneous transformations to the complementary skill set retained for inference\. This reduces dependence on any single evolution trajectory while preserving distinct skill hypotheses\.

Memory\- and Skill\-Based Adaptation\.A growing body of work improves language\-model agents by storing and reusing knowledge derived from prior interactions\([61](https://arxiv.org/html/2608.12486#bib.bib33);[60](https://arxiv.org/html/2608.12486#bib.bib34);[25](https://arxiv.org/html/2608.12486#bib.bib32);[59](https://arxiv.org/html/2608.12486#bib.bib36);[57](https://arxiv.org/html/2608.12486#bib.bib59);[51](https://arxiv.org/html/2608.12486#bib.bib35)\)\. Agent workflow memory\([35](https://arxiv.org/html/2608.12486#bib.bib30)\)summarizes successful trajectories into reusable workflows, while other approaches induce reusable programmatic skills from experience\([34](https://arxiv.org/html/2608.12486#bib.bib31)\)\. These methods demonstrate that natural\-language or structured external memory can support adaptation without weight updates\. Unlike approaches that primarily focus on how experience is stored and retrieved,DIVEfocuses on*how reusable knowledge should be searched, diversified, and selected under stochastic self\-generated revisions*\. It therefore treats skill acquisition as an optimization problem over competing knowledge hypotheses rather than solely as memory construction or retrieval\.

## Conclusion

We introducedDIVE, a diversity\-driven framework for self\-improvement of frozen language models through natural\-language skill evolution\.DIVEindependently evolves multiple skill populations, adaptively allocates the evolution budget across heterogeneous operators, and jointly selects a complementary set of skills\. Across diverse reasoning tasks and model families,DIVEconsistently improves performance, achieves a favorable performance–rollout trade\-off, and produces skills that transfer across model scales and families\. These results highlight diversity\-driven skill evolution as a promising approach for enabling frozen language models to improve from experience\. Future work may explore cross\-task skill transfer and integration with long\-term memory mechanisms to support more scalable and continual self\-improvement\.

## Acknowledgments

This work is supported in part by DARPA SciFy program, Award No\.HR001125C0302, and CISCO Systems, Inc\.

## References

- Agarwalet al\.\(2024\)E\. Agarwal, J\. Singh, V\. Dani, R\. Magazine, T\. Ganu, and A\. NambiPromptwizard: task\-aware prompt optimization framework\.arXiv preprint arXiv:2405\.18369\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Agrawalet al\.\(2025\)L\. A\. Agrawal, S\. Tan, D\. Soylu, N\. Ziems, R\. Khare, K\. Opsahl\-Ong, A\. Singhvi, H\. Shandilya, M\. J\. Ryan, M\. Jiang,et al\.Gepa: reflective prompt evolution can outperform reinforcement learning\.arXiv preprint arXiv:2507\.19457\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p8.1),[Introduction](https://arxiv.org/html/2608.12486#Sx1.p2.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1),[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Baoet al\.\(2025a\)Q\. Bao, X\. Fu, and M\. WitbrockConflict\-aware fusion: mitigating logic inertia in large language models via structured cognitive priors\.arXiv preprint arXiv:2512\.06393\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p1.1)\.
- Baoet al\.\(2026\)Q\. Bao, J\. Leinonen, P\. Denny, and M\. J\. WitbrockRLearner\-llm: balancing logical grounding and fluency in large language models via hybrid direct preference optimization\.arXiv preprint arXiv:2605\.04539\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Baoet al\.\(2025b\)Q\. Bao, J\. Leinonen, A\. Y\. Peng, W\. Zhong, G\. Gendron, T\. Pistotti, A\. Huang, P\. Denny, M\. Witbrock, and J\. LiuExploring iterative enhancement for improving learnersourced multiple\-choice question explanations with large language models\.InProceedings of the Thirty\-Ninth AAAI Conference on Artificial Intelligence and Thirty\-Seventh Conference on Innovative Applications of Artificial Intelligence and Fifteenth Symposium on Educational Advances in Artificial Intelligence,AAAI’25/IAAI’25/EAAI’25\.External Links:ISBN 978\-1\-57735\-897\-8,[Link](https://doi.org/10.1609/aaai.v39i28.35164),[Document](https://dx.doi.org/10.1609/aaai.v39i28.35164)Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Bolanet al\.\(2025\)M\. Bolan, J\. Breitner, J\. Brox, N\. Carlini, M\. Carneiro, F\. van Doorn, M\. Dvorak, A\. Goens, A\. Hill, H\. Husum,et al\.The equational theories project: advancing collaborative mathematical research at scale\.arXiv preprint arXiv:2512\.07087\.Cited by:[Appendix C](https://arxiv.org/html/2608.12486#A3.p1.1),[Appendix C](https://arxiv.org/html/2608.12486#A3.p3.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Brownet al\.\(2020\)T\. Brown, B\. Mann, N\. Ryder, M\. Subbiah, J\. D\. Kaplan, P\. Dhariwal, A\. Neelakantan, P\. Shyam, G\. Sastry, A\. Askell,et al\.Language models are few\-shot learners\.Advances in neural information processing systems33,pp\. 1877–1901\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p1.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Dao \(2023\)T\. DaoFlashattention\-2: faster attention with better parallelism and work partitioning\.arXiv preprint arXiv:2307\.08691\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px2.p2.1)\.
- Dekonincket al\.\(2026\)J\. Dekoninck, N\. Jovanović, T\. Gehrunger, K\. Rögnvaldsson, I\. Petrov, C\. Sun, and M\. VechevBeyond benchmarks: matharena as an evaluation platform for mathematics with llms\.External Links:2605\.00674,[Link](https://arxiv.org/abs/2605.00674)Cited by:[Appendix C](https://arxiv.org/html/2608.12486#A3.p1.1),[Appendix C](https://arxiv.org/html/2608.12486#A3.p2.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Fenget al\.\(2025\)X\. Feng, B\. Liu, Y\. Song, H\. Fu, Z\. Wan, G\. A\. Koushik, Z\. Hu, M\. Yang, Y\. Wen, and J\. WangNatural language reinforcement learning\.External Links:2411\.14251,[Link](https://arxiv.org/abs/2411.14251)Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Fernandoet al\.\(2023\)C\. Fernando, D\. Banarse, H\. Michalewski, S\. Osindero, and T\. RocktäschelPromptbreeder: self\-referential self\-improvement via prompt evolution\.arXiv preprint arXiv:2309\.16797\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Gulcehreet al\.\(2023\)C\. Gulcehre, T\. L\. Paine, S\. Srinivasan, K\. Konyushkova, L\. Weerts, A\. Sharma, A\. Siddhant, A\. Ahern, M\. Wang, C\. Gu,et al\.Reinforced self\-training \(rest\) for language modeling\.arXiv preprint arXiv:2308\.08998\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Gungorduet al\.\(2026\)O\. Gungordu, S\. Xiong, and F\. FekriPathwise: planning through world model for automated heuristic design via self\-evolving llms\.arXiv preprint arXiv:2601\.20539\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Guoet al\.\(2025\)D\. Guo, D\. Yang, H\. Zhang, J\. Song, P\. Wang, Q\. Zhu, R\. Xu, R\. Zhang, S\. Ma, X\. Bi,et al\.Deepseek\-r1: incentivizing reasoning capability in llms via reinforcement learning\.arXiv preprint arXiv:2501\.12948\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Guoet al\.\(2024\)Q\. Guo, R\. Wang, J\. Guo, B\. Li, K\. Song, X\. Tan, G\. Liu, J\. Bian, and Y\. YangConnecting large language models with evolutionary algorithms yields powerful prompt optimizers\.InThe Twelfth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=ZG3RaNIsO8)Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Huet al\.\(2022\)E\. J\. Hu, Y\. Shen, P\. Wallis, Z\. Allen\-Zhu, Y\. Li, S\. Wang, L\. Wang, W\. Chen,et al\.Lora: low\-rank adaptation of large language models\.\.ICLR1\(2\),pp\. 3\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px2.p1.1)\.
- Kwonet al\.\(2023\)W\. Kwon, Z\. Li, S\. Zhuang, Y\. Sheng, L\. Zheng, C\. H\. Yu, J\. E\. Gonzalez, H\. Zhang, and I\. StoicaEfficient memory management for large language model serving with pagedattention\.InProceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles,Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px2.p2.1)\.
- Lewiset al\.\(2020\)P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel,et al\.Retrieval\-augmented generation for knowledge\-intensive nlp tasks\.Advances in neural information processing systems33,pp\. 9459–9474\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p3.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- LIet al\.\(2024\)J\. LI, E\. Beeching, L\. Tunstall, B\. Lipkin, R\. Soletskyi, S\. C\. Huang, K\. Rasul, L\. Yu, A\. Jiang, Z\. Shen, Z\. Qin, B\. Dong, L\. Zhou, Y\. Fleureau, G\. Lample, and S\. PoluNuminaMath\.Numina\.Note:\[https://huggingface\.co/datasets/AI\-MO/NuminaMath\-1\.5\]\(https://github\.com/project\-numina/aimo\-progress\-prize/blob/main/report/numina\_dataset\.pdf\)Cited by:[Appendix C](https://arxiv.org/html/2608.12486#A3.p2.1)\.
- Liuet al\.\(2026\)J\. Liu, Y\. Fan, J\. Zhuo, H\. Ding, Y\. Hu, C\. Zhang, Y\. Shi, S\. Weng, A\. Chen, S\. Chen,et al\.Synlogic: synthesizing verifiable reasoning data at scale for learning logical reasoning and beyond\.Advances in Neural Information Processing Systems38,pp\. 100976–100997\.Cited by:[Appendix C](https://arxiv.org/html/2608.12486#A3.p1.1),[Appendix C](https://arxiv.org/html/2608.12486#A3.p4.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Madaanet al\.\(2023\)A\. Madaan, N\. Tandon, P\. Gupta, S\. Hallinan, L\. Gao, S\. Wiegreffe, U\. Alon, N\. Dziri, S\. Prabhumoye, Y\. Yang,et al\.Self\-refine: iterative refinement with self\-feedback\.Advances in neural information processing systems36,pp\. 46534–46594\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Moneaet al\.\(2025\)G\. Monea, A\. Bosselut, K\. Brantley, and Y\. ArtziLLMs are in\-context bandit reinforcement learners\.External Links:2410\.05362,[Link](https://arxiv.org/abs/2410.05362)Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Novikovet al\.\(2025\)A\. Novikov, N\. Vũ, M\. Eisenberger, E\. Dupont, P\. Huang, A\. Z\. Wagner, S\. Shirobokov, B\. Kozlovskii, F\. J\. R\. Ruiz, A\. Mehrabian, M\. P\. Kumar, A\. See, S\. Chaudhuri, G\. Holland, A\. Davies, S\. Nowozin, P\. Kohli, and M\. BalogAlphaEvolve: a coding agent for scientific and algorithmic discovery\.Technical reportGoogle DeepMind\.Note:White paperExternal Links:[Link](https://storage.googleapis.com/deepmind-media/DeepMind.com/Blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/AlphaEvolve.pdf)Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Opsahl\-Onget al\.\(2024\)K\. Opsahl\-Ong, M\. J\. Ryan, J\. Purtell, D\. Broman, C\. Potts, M\. Zaharia, and O\. KhattabOptimizing instructions and demonstrations for multi\-stage language model programs\.InProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing,Y\. Al\-Onaizan, M\. Bansal, and Y\. Chen \(Eds\.\),Miami, Florida, USA,pp\. 9340–9366\.External Links:[Link](https://aclanthology.org/2024.emnlp-main.525/),[Document](https://dx.doi.org/10.18653/v1/2024.emnlp-main.525)Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p7.1),[Introduction](https://arxiv.org/html/2608.12486#Sx1.p2.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Ouyanget al\.\(2025\)S\. Ouyang, J\. Yan, I\. Hsu, Y\. Chen, K\. Jiang, Z\. Wang, R\. Han, L\. T\. Le, S\. Daruki, X\. Tang,et al\.Reasoningbank: scaling agent self\-evolving with reasoning memory\.arXiv preprint arXiv:2509\.25140\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Samvelyanet al\.\(2024\)M\. Samvelyan, S\. C\. Raparthy, A\. Lupu, E\. Hambro, A\. H\. Markosyan, M\. Bhatt, Y\. Mao, M\. Jiang, J\. Parker\-Holder, J\. Foerster,et al\.Rainbow teaming: open\-ended generation of diverse adversarial prompts\.Advances in Neural Information Processing Systems37,pp\. 69747–69786\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Shaoet al\.\(2024\)Z\. Shao, P\. Wang, Q\. Zhu, R\. Xu, J\. Song, X\. Bi, H\. Zhang, M\. Zhang, Y\. Li, Y\. Wu,et al\.Deepseekmath: pushing the limits of mathematical reasoning in open language models\.arXiv preprint arXiv:2402\.03300\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px2.p1.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Shenget al\.\(2024\)G\. Sheng, C\. Zhang, Z\. Ye, X\. Wu, W\. Zhang, R\. Zhang, Y\. Peng, H\. Lin, and C\. WuHybridFlow: a flexible and efficient rlhf framework\.arXiv preprint arXiv: 2409\.19256\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px2.p2.1)\.
- Shinnet al\.\(2023\)N\. Shinn, F\. Cassano, A\. Gopinath, K\. Narasimhan, and S\. YaoReflexion: language agents with verbal reinforcement learning\.Advances in neural information processing systems36,pp\. 8634–8652\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p2.1),[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Singhet al\.\(2025\)A\. Singh, A\. Fry, A\. Perelman, A\. Tart, A\. Ganesh, A\. El\-Kishky, A\. McLaughlin, A\. Low, A\. Ostrow, A\. Ananthram,et al\.Openai gpt\-5 system card\.arXiv preprint arXiv:2601\.03267\.Cited by:[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Singhet al\.\(2023\)A\. Singh, J\. D\. Co\-Reyes, R\. Agarwal, A\. Anand, P\. Patil, X\. Garcia, P\. J\. Liu, J\. Harrison, J\. Lee, K\. Xu,et al\.Beyond human data: scaling self\-training for problem\-solving with language models\.arXiv preprint arXiv:2312\.06585\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Team \(2026\)Q\. TeamQwen3\. 5\-omni technical report\.arXiv preprint arXiv:2604\.15804\.Cited by:[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Wanget al\.\(2023\)X\. Wang, J\. Wei, D\. Schuurmans, Q\. V\. Le, E\. H\. Chi, S\. Narang, A\. Chowdhery, and D\. ZhouSelf\-consistency improves chain of thought reasoning in language models\.InThe Eleventh International Conference on Learning Representations,Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p1.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Wanget al\.\(2025\)Z\. Z\. Wang, A\. Gandhi, G\. Neubig, and D\. FriedInducing programmatic skills for agentic tasks\.arXiv preprint arXiv:2504\.06821\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Wanget al\.\(2024\)Z\. Z\. Wang, J\. Mao, D\. Fried, and G\. NeubigAgent workflow memory\.arXiv preprint arXiv:2409\.07429\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Xiaoet al\.\(2024\)X\. Xiao, S\. Shen, Q\. Bao, H\. Rong, K\. Liu, Z\. Wang, and J\. LiuCora: optimizing low\-rank adaptation with common subspace of large language models\.arXiv preprint arXiv:2409\.02119\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Xionget al\.\(2026a\)S\. Xiong, O\. Gungordu, J\. C\. Kerce, and F\. FekriAdaptive information control for search\-augmented llm reasoning\.arXiv preprint arXiv:2602\.01672\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p2.1)\.
- Xionget al\.\(2025a\)S\. Xiong, Z\. Liu, J\. Zhou, and Y\. SuDeliberate planning in language models with symbolic representation\.arXiv preprint arXiv:2505\.01479\.Cited by:[Joint Skill Set Selection\.](https://arxiv.org/html/2608.12486#Sx3.SSx4.SSS0.Px1.p1.1)\.
- Xionget al\.\(2025b\)S\. Xiong, A\. Payani, and F\. FekriEnhancing long chain\-of\-thought reasoning through multi\-path plan aggregation\.arXiv preprint arXiv:2510\.11620\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p1.1)\.
- Xionget al\.\(2026b\)S\. Xiong, A\. Payani, and F\. FekriEnhancing language model reasoning with structured multi\-level modeling\.InInternational Conference on Learning Representations,Vol\.2026,pp\. 36557–36610\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p1.1)\.
- Xionget al\.\(2024\)S\. Xiong, A\. Payani, R\. Kompella, and F\. FekriLarge language models can learn temporal reasoning\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 10452–10470\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p1.1)\.
- Xionget al\.\(2025c\)S\. Xiong, A\. Payani, Y\. Yang, and F\. FekriDeliberate reasoning in language models as structure\-aware planning with an accurate world model\.InProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 31900–31931\.Cited by:[Joint Skill Set Selection\.](https://arxiv.org/html/2608.12486#Sx3.SSx4.SSS0.Px1.p1.1)\.
- Xionget al\.\(2025d\)S\. Xiong, J\. Zou, F\. Fekri, and Y\. J\. ChoLong\-context modeling with dynamic hierarchical sparse attention for memory\-constrained llm inference\.arXiv preprint arXiv:2510\.24606\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p2.1)\.
- Xuet al\.\(2026\)A\. Xu, B\. Lin, B\. Xue, B\. Wang, B\. Xu, B\. Wu, B\. Zhang, C\. Lin, C\. Dong, C\. Ling,et al\.Deepseek\-v4: towards highly efficient million\-token context intelligence\.arXiv preprint arXiv:2606\.19348\.Cited by:[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Xuet al\.\(2025\)W\. Xu, A\. Nie, R\. Zheng, A\. Modi, A\. Swaminathan, and C\. ChengProvably learning from language feedback\.External Links:2506\.10341,[Link](https://arxiv.org/abs/2506.10341)Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Yanget al\.\(2025\)A\. Yang, A\. Li, B\. Yang, B\. Zhang, B\. Hui, B\. Zheng, B\. Yu, C\. Gao, C\. Huang, C\. Lv,et al\.Qwen3 technical report\.arXiv preprint arXiv:2505\.09388\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px2.p1.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Yanget al\.\(2024a\)C\. Yang, X\. Wang, Y\. Lu, H\. Liu, Q\. V\. Le, D\. Zhou, and X\. ChenLarge language models as optimizers\.InInternational Conference on Learning Representations,Vol\.2024,pp\. 12028–12068\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Yanget al\.\(2026a\)Y\. Yang, Z\. Gong, W\. Huang, Q\. Yang, Z\. Zhou, Z\. Huang, Y\. Li, X\. Gao, Q\. Dai, B\. Liu,et al\.Skillopt: executive strategy for self\-evolving agent skills\.arXiv preprint arXiv:2605\.23904\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p6.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Yanget al\.\(2024b\)Y\. Yang, S\. Xiong, A\. Payani, E\. Shareghi, and F\. FekriCan llms reason in the wild with programs?\.InFindings of the Association for Computational Linguistics: EMNLP 2024,pp\. 9806–9829\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p1.1)\.
- Yanget al\.\(2024c\)Y\. Yang, S\. Xiong, A\. Payani, E\. Shareghi, and F\. FekriHarnessing the power of large language models for natural language to first\-order logic translation\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 6942–6959\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p1.1)\.
- Yanget al\.\(2026b\)Y\. Yang, J\. Li, Q\. Pan, B\. Zhan, Y\. Cai, L\. Du, J\. Zhou, K\. Chen, Q\. Chen, X\. Li,et al\.Autoskill: experience\-driven lifelong learning via skill self\-evolution\.arXiv preprint arXiv:2603\.01145\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Yaoet al\.\(2023\)S\. Yao, D\. Yu, J\. Zhao, I\. Shafran, T\. Griffiths, Y\. Cao, and K\. NarasimhanTree of thoughts: deliberate problem solving with large language models\.Advances in neural information processing systems36,pp\. 11809–11822\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p2.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Yuet al\.\(2025\)L\. Yu, D\. Chen, S\. Xiong, Q\. Wu, D\. Li, Z\. Chen, X\. Liu, and L\. PanCausaleval: towards better causal reasoning in language models\.InProceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\),pp\. 12512–12540\.Cited by:[Introduction](https://arxiv.org/html/2608.12486#Sx1.p1.1)\.
- Zelikmanet al\.\(2022\)E\. Zelikman, Y\. Wu, J\. Mu, and N\. GoodmanStar: bootstrapping reasoning with reasoning\.Advances in Neural Information Processing Systems35,pp\. 15476–15488\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Zhanget al\.\(2026a\)Z\. Zhang, L\. Ge, H\. Li, W\. Zhu, C\. Zhang, and Y\. YeMapro: recasting multi\-agent prompt optimization as maximum a posteriori inference\.InFindings of the Association for Computational Linguistics: EACL 2026,pp\. 4458–4480\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Zhanget al\.\(2026b\)Z\. Zhang, M\. Mao, H\. Wang, Z\. Wang, S\. Koelle, J\. Yuan, Y\. Lin, J\. Feng, N\. L\. Kuang, Y\. Ye,et al\.Optimizing what policies learn from: recoverability\-aware rollout intervention learning\.arXiv preprint arXiv:2608\.05080\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.
- Zhanget al\.\(2025\)Z\. Zhang, K\. Shi, Z\. Yuan, Z\. Wang, T\. Ma, K\. Murugesan, V\. Galassi, C\. Zhang, and Y\. YeAgentRouter: a knowledge\-graph\-guided llm router for collaborative multi\-agent question answering\.arXiv preprint arXiv:2510\.05445\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Zhaoet al\.\(2024\)A\. Zhao, D\. Huang, Q\. Xu, M\. Lin, Y\. Liu, and G\. HuangExpel: llm agents are experiential learners\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.38,pp\. 19632–19642\.Cited by:[Appendix D](https://arxiv.org/html/2608.12486#A4.SS0.SSS0.Px1.p4.1),[Evaluation](https://arxiv.org/html/2608.12486#Sx4.p1.1)\.
- Zhenget al\.\(2025\)J\. Zheng, S\. Qiu, C\. Shi, and Q\. MaTowards lifelong learning of large language models: a survey\.ACM Computing Surveys57\(8\),pp\. 1–35\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Zhenget al\.\(2024\)L\. Zheng, R\. Wang, X\. Wang, and B\. AnSynapse: trajectory\-as\-exemplar prompting with memory for computer control\.InInternational Conference on Learning Representations,Vol\.2024,pp\. 19036–19066\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Zhonget al\.\(2024\)W\. Zhong, L\. Guo, Q\. Gao, H\. Ye, and Y\. WangMemorybank: enhancing large language models with long\-term memory\.InProceedings of the AAAI conference on artificial intelligence,Vol\.38,pp\. 19724–19731\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p3.1)\.
- Zhouet al\.\(2022\)Y\. Zhou, A\. I\. Muresanu, Z\. Han, K\. Paster, S\. Pitis, H\. Chan, and J\. BaLarge language models are human\-level prompt engineers\.InThe eleventh international conference on learning representations,Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p2.1)\.
- Zuoet al\.\(2026\)Y\. Zuo, K\. Zhang, L\. Sheng, S\. Qu, G\. Cui, X\. Zhu, H\. Li, X\. Long, E\. Hua, B\. Qi,et al\.Ttrl: test\-time reinforcement learning\.Advances in Neural Information Processing Systems38,pp\. 131459–131483\.Cited by:[Related Work](https://arxiv.org/html/2608.12486#Sx5.p1.1)\.

Supplementary Material

## Appendix AAdditional Methodology Details

This section provides further details on our methodology\. Because each skill population is evolved independently, we focus on a single population andomit the population indexkkthroughout for notational simplicity\.

### Seed Skill Initialization

For each population, we construct an initial seed set𝒮0=\{sminimal,sconst,sveri\}\\mathcal\{S\}\_\{0\}=\\left\\\{s\_\{\\mathrm\{minimal\}\},s\_\{\\mathrm\{const\}\},s\_\{\\mathrm\{veri\}\}\\right\\\}\. The three seeds provide complementary initialization biases\. The*minimal seed*sminimals\_\{\\mathrm\{minimal\}\}contains only the task description and any mandatory output constraints\. The remaining two seeds are distilled from the verifier\-labeled trajectories collected on𝒟exp\\mathcal\{D\}\_\{\\mathrm\{exp\}\}\. The*solution\-construction seed*sconsts\_\{\\mathrm\{const\}\}emphasizes successful reasoning procedures, decompositions, representations, and decision rules\. The*diagnosis\-and\-verification seed*sveris\_\{\\mathrm\{veri\}\}emphasizes recurring failure modes, intermediate correctness checks, and final\-answer verification\. Together, these seeds provide a minimal starting hypothesis and two complementary forms of experience\-derived procedural knowledge for subsequent evolution\.

The prompt templates for summarization and skill initialization are shown below\.

DIVE’s Summarization Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Verifier\-Labeled Trajectories\{\{questions, model responses, and verifier outcome labels\}\}\#\#\# InstructionSummarize the trajectories into compact evidence that can guide subsequent skill development\.Identify:1\. Recurring reasoning procedures, representations, or decision rules associated with successful responses;2\. Recurring failure patterns, including incorrect assumptions, invalid reasoning steps, calculation errors, incomplete solutions, and violated task constraints;3\. Verification strategies or intermediate checks that appear to distinguish successful responses from unsuccessful ones;4\. Output\-format, parsing, execution, or timeout failures reported by the verifier;5\. Unresolved weaknesses for which the available trajectories do not yet suggest a reliable correction\.Base the summary only on the provided trajectories and verifier outcomes\.Aggregate recurring patterns across instances rather than reproducing instance\-specific solutions\.Preserve concrete evidence when needed to make a pattern actionable, but omit unnecessary problem details, lengthy derivations, and complete answers\.Do not propose a revised skill or solve the task\.Organize the output using the following headings:\#\# Successful Patterns\#\# Failure Patterns\#\# Verification and Constraint Checks\#\# Unresolved IssuesReturn only the summary\.DIVE’s Seed Skill Initialization Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Experience\{\{summary of verifier\-labeled successful and failed trajectories\}\}\#\#\# InstructionDistill reusable task knowledge from the observed experience into a generalizable natural\-language skill, with particular emphasis on \{\{focus\}\}\.Extract principles and procedures that are useful beyond the observed instances, while avoiding instance\-specific solutions or unnecessary details\.Return only the skill\.
### Evolution Operator Portfolio

DIVEinitializes each skill population with a portfolio of evolution operators designed to induce complementary search biases over the skill space:

𝒜0=\{\\displaystyle\\mathcal\{A\}\_\{0\}=\\\{Reflective Repair,Exploratory Revision,\\displaystyle\\text\{Reflective Repair\},\\text\{Exploratory Revision\},\(19\)Compression,Recombination\}\.\\displaystyle\\text\{Compression\},\\text\{Recombination\}\\\}\.The operators are defined as follows:

- •Reflective Repair\(1 parent\): Locally revises a skill to address systematic failures revealed by verifier\-labeled trajectories while preserving useful existing guidance\.
- •Exploratory Revision\(1 parent\): Encourages exploration of a substantially different solution strategy, decomposition, or reasoning approach rather than incrementally modifying the parent skill\.
- •Compression\(1 parent\): Removes redundant, overly specific, or conflicting guidance and consolidates the remaining knowledge into a more concise and reusable skill\.
- •Recombination\(2 parents\): Synthesizes complementary strengths from two parent skills into a coherent child skill while resolving redundancy or conflicting guidance\.

The prompt templates for each operator are shown below\.

DIVE’s Reflective Repair Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Parent Skill\{\{parent skill\}\}\#\#\# Experience\{\{summary of verifier\-labeled successful and failed trajectories\}\}\#\#\# InstructionAnalyze the parent skill together with its successful and failed trajectories\. Identify systematic failure patterns and the aspects of the parent skill that contributed to successful behavior\. Minimally revise the skill to address the identified weaknesses while preserving useful existing guidance\.The revision should capture generalizable lessons rather than instance\-specific solutions, avoid unnecessary changes or added complexity, and remain applicable to future task instances\.Return only the revised skill\.DIVE’s Exploratory Revision Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Parent Skill\{\{parent skill\}\}\#\#\# Experience\{\{summary of verifier\-labeled successful and failed trajectories\}\}\#\#\# InstructionDevelop a substantially different solution strategy informed by the observed successes and failures\. Reconsider the assumptions, structure, and reasoning approach of the parent skill, and explore an alternative decomposition, representation, or problem\-solving procedure\.The revised skill should remain generally applicable to future instances, preserve any indispensable task knowledge, and avoid merely making local edits to the parent skill\.Return only the revised skill\.DIVE’s Compression Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Parent Skill\{\{parent skill\}\}\#\#\# Experience\{\{summary of verifier\-labeled successful and failed trajectories\}\}\#\#\# InstructionCompress the parent skill into a more concise and coherent form\. Identify and remove redundant, overly specific, conflicting, or unnecessary guidance, while preserving the reasoning procedures, verification strategies, and constraints that contribute to successful behavior\.Abstract repeated or instance\-specific guidance into generalizable principles whenever possible\. Do not sacrifice essential knowledge or introduce new strategies unless needed to resolve inconsistencies\.Return only the revised skill\.DIVE’s Recombination Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Parent Skills\{\{parent skill 1\}\}\{\{parent skill 2\}\}\#\#\# Experience\{\{summary of verifier\-labeled successful and failed trajectories\}\}\#\#\# InstructionCompare the parent skills together with their observed successes and failures\. Identify their complementary reasoning strategies, verification procedures, and specialized knowledge, and synthesize these strengths into a single coherent skill\.Resolve redundant, inconsistent, or conflicting guidance rather than simply concatenating the parent skills\. Preserve generalizable knowledge that contributes to successful behavior and avoid instance\-specific solutions\.Return only the revised skill\.
### Parent Selection

Parent selection is conditioned on the selected evolution operator and the instance\-level behavior of the current skill population\. For each skills∈𝒮ts\\in\\mathcal\{S\}\_\{t\}, we evaluate its correctness on the population\-specific reflection set𝒟ref\\mathcal\{D\}\_\{\\mathrm\{ref\}\}, i\.e\.,

U⁡\(s\)=1\|𝒟ref\|​∑\(x,y\)∈𝒟refr⁡\(x,y,fθ​\(x,s\)\)\.U\(s\)=\\frac\{1\}\{\\left\|\\mathcal\{D\}\_\{\\mathrm\{ref\}\}\\right\|\}\\sum\_\{\(x,y\)\\in\\mathcal\{D\}\_\{\\mathrm\{ref\}\}\}r\\left\(x,y,f\_\{\\theta\}\(x;s\)\\right\)\.\(20\)
The selected operatorata\_\{t\}determines both the required number of parents and the corresponding sampling criterion\. For each single\-parent operator, we define an eligible parent set𝒢at⊆𝒮t\\mathcal\{G\}\_\{a\_\{t\}\}\\subseteq\\mathcal\{S\}\_\{t\}and an operator\-specific parent scoreGat​\(s\)G\_\{a\_\{t\}\}\(s\)\. The parent is sampled according to

psingle​\(s∣at\)=𝕀\[s∈𝒢at\]exp\(Gat\(s\)/τp\)∑s~∈𝒢atexp⁡\(Gat​\(s~\)/τp\),p\_\{\\mathrm\{single\}\}\(s\\mid a\_\{t\}\)=\\frac\{\\mathbb\{I\}\[s\\in\\mathcal\{G\}\_\{a\_\{t\}\}\]\\exp\\left\(G\_\{a\_\{t\}\}\(s\)/\\tau\_\{\\mathrm\{p\}\}\\right\)\}\{\\displaystyle\\sum\_\{\\tilde\{s\}\\in\\mathcal\{G\}\_\{a\_\{t\}\}\}\\exp\\left\(G\_\{a\_\{t\}\}\(\\tilde\{s\}\)/\\tau\_\{\\mathrm\{p\}\}\\right\)\},\(21\)whereτp\>0\\tau\_\{\\mathrm\{p\}\}\>0controls the sampling temperature\. Lower values place greater probability on skills with the highest operator\-specific scores, whereas larger values preserve greater parent diversity\. Forτp=0\\tau\_\{\\mathrm\{p\}\}=0, we use greedy selection\.

Reflective Repairis applied preferentially to high\-performing skills so that systematic errors can be corrected while preserving useful existing guidance\. All current skills are eligible, and the parent score is its reflection\-set performance:

𝒢repair=𝒮t,Grepair​\(s\)=U⁡\(s\)\.\\mathcal\{G\}\_\{\\mathrm\{repair\}\}=\\mathcal\{S\}\_\{t\},\\quad G\_\{\\mathrm\{repair\}\}\(s\)=U\(s\)\.\(22\)
Exploratory Revisiontargets lower\-performing skills for which incremental repair may be insufficient and a substantially different strategy may be beneficial\. All skills are eligible, with

𝒢explore=𝒮t,Gexplore​\(s\)=1−U⁡\(s\)\.\\mathcal\{G\}\_\{\\mathrm\{explore\}\}=\\mathcal\{S\}\_\{t\},\\quad G\_\{\\mathrm\{explore\}\}\(s\)=1\-U\(s\)\.\(23\)
Compressionis applied only to skills whose token length exceeds a predefined threshold\. Letℓ⁡\(s\)\\ell\(s\)denote the token length of skillss, and letℓcomp\\ell\_\{\\mathrm\{comp\}\}denote the compression threshold\. The eligible set is

𝒢compress=\{s∈𝒮t:ℓ⁡\(s\)\>ℓcomp\}\.\\mathcal\{G\}\_\{\\mathrm\{compress\}\}=\\left\\\{s\\in\\mathcal\{S\}\_\{t\}:\\ell\(s\)\>\\ell\_\{\\mathrm\{comp\}\}\\right\\\}\.\(24\)Among the eligible skills, we favor those with higher performance:

Gcompress​\(s\)=U⁡\(s\),s∈𝒢compress\.G\_\{\\mathrm\{compress\}\}\(s\)=U\(s\),\\quad s\\in\\mathcal\{G\}\_\{\\mathrm\{compress\}\}\.\(25\)This encourages the operator to shorten effective but overly long skills\. If no current skill exceedsℓcomp\\ell\_\{\\mathrm\{comp\}\}, Compression is considered inapplicable at that evolution step\.

For theRecombinationoperator, we first sample a strong parent according to its reflection\-set performance:

pdual​\(s1=s\)=exp⁡\(U⁡\(s\)/τp\)∑s~∈𝒮texp⁡\(U⁡\(s~\)/τp\),s∈𝒮t\.p\_\{\\mathrm\{dual\}\}\(s\_\{1\}=s\)=\\frac\{\\exp\\left\(U\(s\)/\\tau\_\{\\mathrm\{p\}\}\\right\)\}\{\\displaystyle\\sum\_\{\\tilde\{s\}\\in\\mathcal\{S\}\_\{t\}\}\\exp\\left\(U\(\\tilde\{s\}\)/\\tau\_\{\\mathrm\{p\}\}\\right\)\},\\quad s\\in\\mathcal\{S\}\_\{t\}\.\(26\)
Given the first parents1s\_\{1\}, we quantify the marginal coverage provided by another skillssas

Δ⁡\(s∣s1\)=1\|𝒟ref\|​∑\(x,y\)∈𝒟ref\(1−c⁡\(s1,x,y\)\)​c​\(s,x,y\)\.\\Delta\(s\\mid s\_\{1\}\)=\\frac\{1\}\{\\left\|\\mathcal\{D\}\_\{\\mathrm\{ref\}\}\\right\|\}\\sum\_\{\(x,y\)\\in\\mathcal\{D\}\_\{\\mathrm\{ref\}\}\}\\left\(1\-c\(s\_\{1\};x,y\)\\right\)c\(s;x,y\)\.\(27\)This score measures the fraction of reflection instances solved byssbut not bys1s\_\{1\}\.

To favor second parents that are both individually effective and complementary to the first parent, we define

Q⁡\(s∣s1\)=λ​U​\(s\)\+\(1−λ\)​Δ​\(s∣s1\),Q\(s\\mid s\_\{1\}\)=\\lambda U\(s\)\+\(1\-\\lambda\)\\Delta\(s\\mid s\_\{1\}\),\(28\)whereλ∈\[0,1\]\\lambda\\in\[0,1\]balances individual performance and marginal coverage\. The second parent is then sampled according to

pdual​\(s2=s∣s1\)=exp⁡\(Q⁡\(s∣s1\)/τp\)∑s~∈𝒮t∖\{s1\}exp⁡\(Q⁡\(s~∣s1\)/τp\),p\_\{\\mathrm\{dual\}\}\(s\_\{2\}=s\\mid s\_\{1\}\)=\\frac\{\\exp\\left\(Q\(s\\mid s\_\{1\}\)/\\tau\_\{\\mathrm\{p\}\}\\right\)\}\{\\displaystyle\\sum\_\{\\tilde\{s\}\\in\\mathcal\{S\}\_\{t\}\\setminus\\\{s\_\{1\}\\\}\}\\exp\\left\(Q\(\\tilde\{s\}\\mid s\_\{1\}\)/\\tau\_\{\\mathrm\{p\}\}\\right\)\},\(29\)wheres∈𝒮t∖\{s1\}s\\in\\mathcal\{S\}\_\{t\}\\setminus\\\{s\_\{1\}\\\}\. The resulting parent set is𝒫t=\{s1\}\\mathcal\{P\}\_\{t\}=\\\{s\_\{1\}\\\}for a single\-parent operator and𝒫t=\{s1,s2\}\\mathcal\{P\}\_\{t\}=\\\{s\_\{1\},s\_\{2\}\\\}forRecombination\. Overall,Reflective Repairfavors strong skills,Exploratory Revisionfavors weaker skills,Compressionfavors strong skills that exceed the length constraint, andRecombinationpairs a strong first parent with a second parent exhibiting complementary instance\-level coverage\.

DIVE’s Adaptive Operator Generation Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Existing Evolution Operators\{\{operator names, parent arities, and transformation instructions\}\}\#\#\# Evolution History\{\{summary of selected operators, parent skills, proposed revisions, and parent\-relative rewards\}\}\#\#\# InstructionAnalyze the evolution history and the existing operator portfolio\. Identify recurring failure patterns, unproductive revision behaviors, or useful transformations that are not adequately addressed by the current operators\.Propose exactly \{\{NnewN\_\{\\mathrm\{new\}\}\}\} new evolution operators that introduce distinct and practically useful transformation strategies\.For each proposed operator, provide:1\. The portfolio gap or recurring failure pattern it is intended to address;2\. Supporting evidence from the evolution history;3\. An explanation of how it differs from the most similar existing operator;4\. A concise operator name;5\. The required number of parent skills, which must be either 1 or 2;6\. A clear instruction specifying how the parent skill or skills should be transformed\.Each operator should be generalizable beyond the observed instances\. Avoid superficial renaming, unnecessary duplication, and minor variants of existing operators\. Do not include task\-specific solutions or instance\-specific guidance\.Return exactly \{\{NnewN\_\{\\mathrm\{new\}\}\}\} operators as a JSON list using the following schema:```
[
  {
    "targeted_gap": "<failure pattern or missing transformation addressed>",
    "supporting_evidence": "<evidence from the evolution history>",
    "distinction": "<how this differs from the closest existing operator>",
    "name": "<concise operator name>",
    "parent_arity": <1 or 2>,
    "instruction": "<transformation instruction>"
  }
]
```

Return only the JSON list\.
### Adaptive Operator Generation

Although the initial operator portfolio provides several complementary transformation strategies, a fixed portfolio may not adequately address all failure patterns that emerge during evolution\. We therefore allow each skill population to generate additional operators from its own accumulated evolution history\.

For each population, we record the evolution history up to stepttas

ℋt=\{\(aτ,𝒫τ,sτ′,Rτ\)\}τ=1t,\\mathcal\{H\}\_\{t\}=\\left\\\{\\left\(a\_\{\\tau\},\\mathcal\{P\}\_\{\\tau\},s^\{\\prime\}\_\{\\tau\},R\_\{\\tau\}\\right\)\\right\\\}\_\{\\tau=1\}^\{t\},\(30\)whereaτa\_\{\\tau\}is the selected operator,𝒫τ\\mathcal\{P\}\_\{\\tau\}is the corresponding parent set,sτ′s^\{\\prime\}\_\{\\tau\}is the proposed revision, andRτR\_\{\\tau\}is its parent\-relative reward\. We compute this reward on the population\-specific reflection set:

Rτ=U⁡\(sτ′\)−maxs∈𝒫τ⁡U⁡\(s\)\.R\_\{\\tau\}=U\(s^\{\\prime\}\_\{\\tau\}\)\-\\max\_\{s\\in\\mathcal\{P\}\_\{\\tau\}\}U\(s\)\.\(31\)For multi\-parent operators, comparison against the strongest parent prevents a proposal from receiving a positive reward merely by improving over a weaker parent\.

Because the complete evolution history may exceed the context window, we convert it into a compact structured summaryℋ¯t\\overline\{\\mathcal\{H\}\}\_\{t\}\. For each existing operatoraa, the summary includes its number of applications,

Na\(t\)=∑τ=1t𝕀\[aτ=a\],N\_\{a\}\(t\)=\\sum\_\{\\tau=1\}^\{t\}\\mathbb\{I\}\[a\_\{\\tau\}=a\],\(32\)its empirical mean reward,

μ^a\(t\)=1Na​\(t\)∑τ≤t:aτ=aRτ,\\widehat\{\\mu\}\_\{a\}\(t\)=\\frac\{1\}\{N\_\{a\}\(t\)\}\\sum\_\{\\tau\\leq t:\\,a\_\{\\tau\}=a\}R\_\{\\tau\},\(33\)and its positive\-improvement rate,

qa\+\(t\)=1Na​\(t\)∑τ≤t:aτ=a𝕀\[Rτ\>0\]\.q\_\{a\}^\{\+\}\(t\)=\\frac\{1\}\{N\_\{a\}\(t\)\}\\sum\_\{\\tau\\leq t:\\,a\_\{\\tau\}=a\}\\mathbb\{I\}\[R\_\{\\tau\}\>0\]\.\(34\)The summary additionally contains representative successful and unsuccessful revisions, recurring failure patterns that remain unresolved across the population, and effective transformations observed in the history but not explicitly represented by the current operator portfolio\.

At a predefined steptnewt\_\{\\mathrm\{new\}\}, we use the summarized evolution history to generateNnewN\_\{\\mathrm\{new\}\}new operators in a single model call:

𝒜new=GenerateOperatorfθ⁡\(ℋ¯tnew,Nnew\)\.\\mathcal\{A\}\_\{\\mathrm\{new\}\}=\\operatorname\{GenerateOperator\}\_\{f\_\{\\theta\}\}\\left\(\\overline\{\\mathcal\{H\}\}\_\{t\_\{\\mathrm\{new\}\}\},N\_\{\\mathrm\{new\}\}\\right\)\.\(35\)The model is instructed to proposeNnewN\_\{\\mathrm\{new\}\}different operators that address recurring failure patterns or useful transformations insufficiently covered by the existing portfolio\. The generated operators are directly added to the operator pool:

𝒜←𝒜∪𝒜new\.\\mathcal\{A\}\\leftarrow\\mathcal\{A\}\\cup\\mathcal\{A\}\_\{\\mathrm\{new\}\}\.\(36\)
Each generated proposal contains both diagnostic metadata and an executable operator specification:

a~=\(ga,ea,da,na,ha,πa\),\\widetilde\{a\}=\\left\(g\_\{a\},e\_\{a\},d\_\{a\},n\_\{a\},h\_\{a\},\\pi\_\{a\}\\right\),\(37\)wheregag\_\{a\}identifies the targeted portfolio gap,eae\_\{a\}summarizes supporting evidence from the evolution history,dad\_\{a\}explains how the proposal differs from its closest existing operator,nan\_\{a\}is the operator name,hah\_\{a\}is its required number of parents, andπa\\pi\_\{a\}is its transformation instruction\. The diagnostic fields\(ga,ea,da\)\(g\_\{a\},e\_\{a\},d\_\{a\}\)encourage grounded and non\-redundant operator generation, whereas only the executable specification\(na,ha,πa\)\(n\_\{a\},h\_\{a\},\\pi\_\{a\}\)is retained for subsequent evolution\.

The adaptive operator generation prompt is shown below\.

DIVE’s Candidate Ranking Prompt Template\#\#\# Task\{\{task description\}\}\#\#\# Candidate Solutions\#\#\#\# Candidate 1\{\{Candidate 1’s response\}\}\#\#\#\# Candidate 2\{\{Candidate 2’s response\}\}⋮\\vdots\#\#\#\# CandidateMM\{\{CandidateMM’s response\}\}\#\#\# InstructionEvaluate the candidate solutions and select the single candidate most likely to correctly solve the question\.Consider:1\. Whether the reasoning is logically valid and sufficiently complete;2\. Whether intermediate conclusions and calculations are internally consistent;3\. Whether the final answer follows from the reasoning;4\. Whether the solution satisfies all task\-specific constraints and output requirements\.Select exactly one of the provided candidates\.Return only the index of the selected candidate\.
### Joint Skill Set Selection

After independently evolving all populations, we construct the final skill set using the shared validation set𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}\. Rather than selecting skills solely according to their individual performance, we seek a set whose predictions are complementary under the complete inference\-time procedure\.

We can define the empirical validation utility of a single skillssas

V^𝒟val​\(\{s\}\)=1\|𝒟val\|​∑\(x,y\)∈𝒟valr⁡\(x,y,o^\{s\}​\(x\)\),\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\(\\\{s\\\}\)=\\frac\{1\}\{\|\\mathcal\{D\}\_\{\\mathrm\{val\}\}\|\}\\sum\_\{\(x,y\)\\in\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}r\\left\(x,y,\\widehat\{o\}\_\{\\\{s\\\}\}\(x\)\\right\),\(38\)whereo^\{s\}​\(x\)=fθ​\(x,s\)\\widehat\{o\}\_\{\\\{s\\\}\}\(x\)=f\_\{\\theta\}\(x;s\)for a singleton set\.

To reduce the cost of joint selection, we first retain the topLLskills from each evolved population according to their validation performance:

𝒞\(k\)=TopL⁡\(𝒮B\(k\);V^𝒟val​\(\{s\}\)\),\\mathcal\{C\}^\{\(k\)\}=\\operatorname\{TopL\}\\left\(\\mathcal\{S\}\_\{B\}^\{\(k\)\};\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\(\\\{s\\\}\)\\right\),\(39\)and form the shortlisted candidate pool

𝒞=⋃k=1K𝒞\(k\)\.\\mathcal\{C\}=\\bigcup\_\{k=1\}^\{K\}\\mathcal\{C\}^\{\(k\)\}\.\(40\)Letκ⁡\(s\)∈\[K\]\\kappa\(s\)\\in\[K\]denote the index of the population from which skillssoriginates\.

We greedily construct the final skill set\. The first skill is selected according to its validation utility:

s1⋆=arg⁡maxs∈𝒞​V^𝒟val​\(\{s\}\),𝒮1=\{s1⋆\}\.s\_\{1\}^\{\\star\}=\\arg\\max\_\{s\\in\\mathcal\{C\}\}\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\(\\\{s\\\}\),\\quad\\mathcal\{S\}\_\{1\}=\\\{s\_\{1\}^\{\\star\}\\\}\.\(41\)
At selection stepj≥2j\\geq 2, the eligible candidate set is

𝒞j=\{s∈𝒞∖𝒮j−1:κ⁡\(s\)∉\{κ⁡\(s~\):s~∈𝒮j−1\}\},\\mathcal\{C\}\_\{j\}=\\left\\\{s\\in\\mathcal\{C\}\\setminus\\mathcal\{S\}\_\{j\-1\}:\\kappa\(s\)\\notin\\left\\\{\\kappa\(\\widetilde\{s\}\):\\widetilde\{s\}\\in\\mathcal\{S\}\_\{j\-1\}\\right\\\}\\right\\\},\(42\)which ensures that at most one skill is selected from each population\.

For every eligible skillss, we compute its marginal contribution to the validation utility of the complete skill set:

Δ⁡\(s∣𝒮j−1\)=V^𝒟val​\(𝒮j−1∪\{s\}\)−V^𝒟val​\(𝒮j−1\)\.\\Delta\\left\(s\\mid\\mathcal\{S\}\_\{j\-1\}\\right\)=\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\\left\(\\mathcal\{S\}\_\{j\-1\}\\cup\\\{s\\\}\\right\)\-\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\\left\(\\mathcal\{S\}\_\{j\-1\}\\right\)\.\(43\)We then select

sj⋆=arg⁡maxs∈𝒞j⁡Δ⁡\(s∣𝒮j−1\),𝒮j=𝒮j−1∪\{sj⋆\}\.s\_\{j\}^\{\\star\}=\\arg\\max\_\{s\\in\\mathcal\{C\}\_\{j\}\}\\Delta\\left\(s\\mid\\mathcal\{S\}\_\{j\-1\}\\right\),\\quad\\mathcal\{S\}\_\{j\}=\\mathcal\{S\}\_\{j\-1\}\\cup\\\{s\_\{j\}^\{\\star\}\\\}\.\(44\)
The procedure continues until the maximum skill\-set sizeMMis reached or no eligible skill provides a positive marginal improvement\. To reduce evaluation variance and computation, we generate and cache each skill’s response to every validation instance once\.

### Inference\-Time Candidate Ranking

Given a questionxxand a selected skill set𝒮\\mathcal\{S\}, each skill independently generates one candidate response:

𝒪𝒮​\(x\)=\{os​\(x\)\}s∈𝒮\\mathcal\{O\}\_\{\\mathcal\{S\}\}\(x\)=\\\{o\_\{s\}\(x\)\\\}\_\{s\\in\\mathcal\{S\}\}\(45\)For HMMT, we extract the final answer from each candidate response and select the answer using majority voting\. For the remaining datasets, we present all candidate responses \(no lengthy reasoning content\) to the same frozen model in a single listwise ranking call:

o^𝒮​\(x\)=SelectTopfθ⁡\(x,𝒪𝒮​\(x\)\)\.\\widehat\{o\}\_\{\\mathcal\{S\}\}\(x\)=\\operatorname\{SelectTop\}\_\{f\_\{\\theta\}\}\\left\(x,\\mathcal\{O\}\_\{\\mathcal\{S\}\}\(x\)\\right\)\.\(46\)
The model jointly compares the candidate solutions based on the validity and completeness of their reasoning, the consistency between their reasoning and final answers, and their adherence to task\-specific constraints and output requirements\. On𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}, the external verifier evaluates the selected candidate only after ranking to computeV^𝒟val​\(𝒮\)\\widehat\{V\}\_\{\\mathcal\{D\}\_\{\\mathrm\{val\}\}\}\(\\mathcal\{S\}\)\. The same ranking procedures are used throughout test\-time evaluation without access to test labels\. The ranking prompt template is shown below\.

## Appendix BTheoretical Analysis

This section provides theoretical motivation for two central components ofDIVE: adaptive allocation among heterogeneous evolution operators and independent evolution followed by joint skill set selection\.

### Adaptive Allocation of Evolution Operators

An evolution operator determines not only how a parent skill is revised but also which parents are eligible and how they are sampled\. We therefore treat an operatoraaas a complete proposal mechanism consisting of its parent arity, parent\-selection distribution, and natural\-language transformation instruction\.

Letqa​\(𝒫∣𝒮t\)q\_\{a\}\\left\(\\mathcal\{P\}\\mid\\mathcal\{S\}\_\{t\}\\right\)denote the distribution over parent sets induced by operatoraaat steptt\. After sampling𝒫t∼qa\(⋅∣𝒮t\)\\mathcal\{P\}\_\{t\}\\sim q\_\{a\}\(\\cdot\\mid\\mathcal\{S\}\_\{t\}\), the frozen model proposes

st′∼pfθ\(⋅∣𝒫t,ℰ\(𝒟ref;𝒫t\),a\)\.s^\{\\prime\}\_\{t\}\\sim p\_\{f\_\{\\theta\}\}\\left\(\\cdot\\mid\\mathcal\{P\}\_\{t\},\\mathcal\{E\}\(\\mathcal\{D\}\_\{\\mathrm\{ref\}\};\\mathcal\{P\}\_\{t\}\),a\\right\)\.\(47\)Thus, the observed performance of an operator reflects the complete combination of parent selection and skill transformation\.

#### Useful Proposal Mass under a Finite Budget\.

For a parent set𝒫\\mathcal\{P\}and improvement thresholdϵ\>0\\epsilon\>0, define the set ofϵ\\epsilon\-improving revisions as

ℐϵ​\(𝒫\)=\{s′:U⁡\(s′\)−maxs∈𝒫⁡U⁡\(s\)≥ϵ\}\.\\mathcal\{I\}\_\{\\epsilon\}\(\\mathcal\{P\}\)=\\left\\\{s^\{\\prime\}:U\(s^\{\\prime\}\)\-\\max\_\{s\\in\\mathcal\{P\}\}U\(s\)\\geq\\epsilon\\right\\\}\.\(48\)Conditioned on the evolution historyℋt−1\\mathcal\{H\}\_\{t\-1\}, the useful proposal mass of operatoraais

pa,t​\(ϵ\)=Pr⁡\(st′∈ℐϵ​\(𝒫t\)∣at=a,ℋt−1\)\.p\_\{a,t\}\(\\epsilon\)=\\Pr\\left\(s^\{\\prime\}\_\{t\}\\in\\mathcal\{I\}\_\{\\epsilon\}\(\\mathcal\{P\}\_\{t\}\)\\mid a\_\{t\}=a,\\mathcal\{H\}\_\{t\-1\}\\right\)\.\(49\)where the probability is taken over both𝒫t∼qa\(⋅∣𝒮t\)\\mathcal\{P\}\_\{t\}\\sim q\_\{a\}\(\\cdot\\mid\\mathcal\{S\}\_\{t\}\)and the model\-generated revision in[Equation47](https://arxiv.org/html/2608.12486#A2.E47)\.

This quantity measures how much probability the complete proposal mechanism places on revisions that improve over their own starting points\. An operator can therefore be useful even when it does not produce the highest\-utility child on average, provided that it assigns substantial probability to transformations not easily reached by the other operators\.

Suppose the optimizer makesTTproposals, and define the conditional improvement hazard

p¯t​\(ϵ\)=Pr⁡\(Rt≥ϵ∣R1<ϵ,…,Rt−1<ϵ\)\.\\overline\{p\}\_\{t\}\(\\epsilon\)=\\Pr\\left\(R\_\{t\}\\geq\\epsilon\\mid R\_\{1\}<\\epsilon,\\ldots,R\_\{t\-1\}<\\epsilon\\right\)\.\(50\)By the chain rule,

Pr⁡\(max1≤t≤T⁡Rt≥ϵ\)=1−∏t=1T\(1−p¯t​\(ϵ\)\)\.\\Pr\\left\(\\max\_\{1\\leq t\\leq T\}R\_\{t\}\\geq\\epsilon\\right\)=1\-\\prod\_\{t=1\}^\{T\}\\left\(1\-\\overline\{p\}\_\{t\}\(\\epsilon\)\\right\)\.\(51\)Accordingly, finite\-budget search improves when the selected proposal mechanisms maintain high useful proposal mass over the sequence of search states encountered during evolution\.

A heterogeneous portfolio is valuable because the most productive proposal mechanism may change as the population changes\.Reflective Repairmay be effective once a strong but imperfect skill has been identified,Exploratory Revisionmay be more useful when current strategies share a common failure mode, andRecombinationmay become useful only after complementary skills have emerged\. A single fixed proposal mechanism need not assign high useful mass in all of these search states\.

#### Parent\-Relative Credit Assignment\.

The reward compares the proposed child with its strongest parent\. For a multi\-parent operator, this prevents a child from receiving positive credit merely because it improves over a weak parent\. It also separates proposal quality from absolute parent quality\.

For operatoraa, define its conditional expected parent\-relative reward as

μa,t=𝔼\[Rt∣at=a,ℋt−1\]\.\\mu\_\{a,t\}=\\mathbb\{E\}\\left\[R\_\{t\}\\mid a\_\{t\}=a,\\mathcal\{H\}\_\{t\-1\}\\right\]\.\(52\)Bothμa,t\\mu\_\{a,t\}andpa,t​\(ϵ\)p\_\{a,t\}\(\\epsilon\)may vary withttbecause the population, eligible parents, unresolved failure modes, and available evolution history change during optimization\. The operator\-allocation problem is therefore generally non\-stationary\.

The UCB rule used byDIVEestimates the historical average reward of each operator and balances this empirical productivity against uncertainty from limited observations\. After every available operator has received an initial trial, its score is

UCBa⁡\(t\)=μ^a​\(t\)\+β​log⁡tNa​\(t\)\.\\operatorname\{UCB\}\_\{a\}\(t\)=\\widehat\{\\mu\}\_\{a\}\(t\)\+\\beta\\sqrt\{\\frac\{\\log t\}\{N\_\{a\}\(t\)\}\}\.\(53\)The first term favors proposal mechanisms that have achieved larger parent\-relative improvements, while the second continues to test mechanisms with fewer observations\.

Since the reward distribution changes as the skill population evolves, we do not invoke the standard regret guarantees for stationary stochastic bandits\. Instead, UCB serves as a practical finite\-budget allocation rule that concentrates proposals on empirically productive mechanisms without prematurely eliminating underexplored alternatives\.

Adaptive operator generation further expands the portfolio when the existing mechanisms place insufficient proposal mass on transformations suggested by the accumulated evolution history\.

### Independent Populations and Joint Skill Set Selection

Natural\-language skill evolution is stochastic and path\-dependent\. Different bootstrapped examples, initial skills, sampled parents, and model\-generated revisions can lead to different regions of the skill space\. Independent populations improve the probability of discovering useful candidate skills and can produce skills with complementary instance\-level success patterns\.

#### Candidate\-Pool Search Coverage\.

For a skillss, define its population risk on the task distribution𝒯\\mathcal\{T\}as

ℛ⁡\(s\)=𝔼\(x,y\)∼𝒯​\[1−r⁡\(x,y,fθ​\(x,s\)\)\]\.\\mathcal\{R\}\(s\)=\\mathbb\{E\}\_\{\(x,y\)\\sim\\mathcal\{T\}\}\\left\[1\-r\\left\(x,y,f\_\{\\theta\}\(x;s\)\\right\)\\right\]\.\(54\)
Let

Gk\(ϵ\)=\{mins∈𝒮B\(k\)ℛ\(s\)≤ϵ\}\.G\_\{k\}\(\\epsilon\)=\\left\\\{\\min\_\{s\\in\\mathcal\{S\}\_\{B\}^\{\(k\)\}\}\\mathcal\{R\}\(s\)\\leq\\epsilon\\right\\\}\.\(55\)denote the event that evolved populationkkcontains at least one skill with risk at mostϵ\\epsilon\.

Under the idealized assumptions that the eventsGk​\(ϵ\)k=1K\{G\_\{k\}\(\\epsilon\)\}\_\{k=1\}^\{K\}are independent and thatPr⁡\(Gk​\(ϵ\)\)=qϵ\\Pr\(G\_\{k\}\(\\epsilon\)\)=q\_\{\\epsilon\}for every population,

Pr⁡\(⋃k=1KGk​\(ϵ\)\)=1−\(1−qϵ\)K\.\\Pr\\left\(\\bigcup\_\{k=1\}^\{K\}G\_\{k\}\(\\epsilon\)\\right\)=1\-\\left\(1\-q\_\{\\epsilon\}\\right\)^\{K\}\.\(56\)Thus, independent evolution increases the probability that the overall candidate pool contains at least one low\-risk skill, with diminishing returns as the number of populations grows\.

The populations are not perfectly independent in practice\. Nevertheless, independently bootstrapped experience, population\-specific reflection subsets, stochastic revisions, and separate evolution histories encourage lower dependence across runs\. A discovered skill must still survive validation shortlisting, contribute to the selected skill set, and be successfully aggregated at inference time\.

#### Instance\-Level Complementarity\.

For an instance\(x,y\)\(x,y\), define the set of skills producing correct candidates as

C𝒮​\(x,y\)=\{s∈𝒮:r⁡\(x,y,os​\(x\)\)=1\}\.C\_\{\\mathcal\{S\}\}\(x,y\)=\\left\\\{s\\in\\mathcal\{S\}:r\\left\(x,y,o\_\{s\}\(x\)\\right\)=1\\right\\\}\.\(57\)The oracle coverage of𝒮\\mathcal\{S\}is

Aoracle​\(𝒮\)=Pr\(x,y\)∼𝒯⁡\(C𝒮​\(x,y\)≠∅\)\.A\_\{\\mathrm\{oracle\}\}\(\\mathcal\{S\}\)=\\Pr\_\{\(x,y\)\\sim\\mathcal\{T\}\}\\left\(C\_\{\\mathcal\{S\}\}\(x,y\)\\neq\\varnothing\\right\)\.\(58\)This is the accuracy that would be obtained by an oracle capable of selecting a correct candidate whenever at least one exists\.

For a new skills∉𝒮s\\notin\\mathcal\{S\}, its marginal oracle coverage is

Δcov​\(s∣𝒮\)=Pr\(x,y\)∼𝒯⁡\(CLOSEr⁡\(x,y,os​\(x\)\)=1,OPENC𝒮​\(x,y\)=∅\)\.\\begin\{split\}\\Delta\_\{\\mathrm\{cov\}\}\\left\(s\\mid\\mathcal\{S\}\\right\)=\\Pr\_\{\(x,y\)\\sim\\mathcal\{T\}\}\\Big\(&r\\left\(x,y,o\_\{s\}\(x\)\\right\)=1,\\\\ &C\_\{\\mathcal\{S\}\}\(x,y\)=\\varnothing\\Big\)\.\\end\{split\}\(59\)Therefore,

Aoracle​\(𝒮∪\{s\}\)−Aoracle​\(𝒮\)=Δcov​\(s∣𝒮\)\.A\_\{\\mathrm\{oracle\}\}\\left\(\\mathcal\{S\}\\cup\\\{s\\\}\\right\)\-A\_\{\\mathrm\{oracle\}\}\(\\mathcal\{S\}\)=\\Delta\_\{\\mathrm\{cov\}\}\\left\(s\\mid\\mathcal\{S\}\\right\)\.\(60\)A skill contributes to oracle coverage only on instances not already solved by the current set\. Consequently, a skill with lower standalone accuracy may be more useful than a higher\-accuracy skill when its correct predictions occur on different instances\. This motivates selecting skills according to their marginal contribution rather than solely according to individual validation performance\.

#### Candidate Coverage and Selection Regret\.

Leto^𝒮​\(x\)\\widehat\{o\}\_\{\\mathcal\{S\}\}\(x\)denote the output returned by the aggregation procedure applied to the candidates generated by𝒮\\mathcal\{S\}\. Its realized accuracy is

Aagg\(𝒮\)=Pr\(x,y\)∼𝒯\[r\(x,y,o^𝒮\(x\)\)=1\]\.A\_\{\\mathrm\{agg\}\}\(\\mathcal\{S\}\)=\\Pr\_\{\(x,y\)\\sim\\mathcal\{T\}\}\\left\[r\\left\(x,y,\\widehat\{o\}\_\{\\mathcal\{S\}\}\(x\)\\right\)=1\\right\]\.\(61\)
Because the aggregation procedure selects from the candidate outputs, a correct final answer is possible only when at least one candidate is correct\. We can therefore decompose aggregation accuracy as

Aagg​\(𝒮\)=Aoracle​\(𝒮\)−Lsel​\(𝒮\)\.A\_\{\\mathrm\{agg\}\}\(\\mathcal\{S\}\)=A\_\{\\mathrm\{oracle\}\}\(\\mathcal\{S\}\)\-L\_\{\\mathrm\{sel\}\}\(\\mathcal\{S\}\)\.\(62\)where

Lsel​\(𝒮\)=Pr\(x,y\)∼𝒯⁡\(CLOSEC𝒮​\(x,y\)≠∅,OPENr⁡\(x,y,o^𝒮​\(x\)\)=0\)\.\\begin\{split\}L\_\{\\mathrm\{sel\}\}\(\\mathcal\{S\}\)=\\Pr\_\{\(x,y\)\\sim\\mathcal\{T\}\}\\Big\(&C\_\{\\mathcal\{S\}\}\(x,y\)\\neq\\varnothing,\\\\ &r\\left\(x,y,\\widehat\{o\}\_\{\\mathcal\{S\}\}\(x\)\\right\)=0\\Big\)\.\\end\{split\}\(63\)is the selection regret: the probability that at least one correct candidate is available but the aggregation procedure returns an incorrect one\.

Combining[Equations60](https://arxiv.org/html/2608.12486#A2.E60)and[62](https://arxiv.org/html/2608.12486#A2.E62), the realized marginal gain from adding skillssis

Aagg​\(𝒮∪\{s\}\)−Aagg​\(𝒮\)=Δcov​\(s∣𝒮\)−Δsel​\(s∣𝒮\)\.\\begin\{split\}&A\_\{\\mathrm\{agg\}\}\\left\(\\mathcal\{S\}\\cup\\\{s\\\}\\right\)\-A\_\{\\mathrm\{agg\}\}\(\\mathcal\{S\}\)\\\\ &\\qquad=\\Delta\_\{\\mathrm\{cov\}\}\\left\(s\\mid\\mathcal\{S\}\\right\)\-\\Delta\_\{\\mathrm\{sel\}\}\\left\(s\\mid\\mathcal\{S\}\\right\)\.\\end\{split\}\(64\)where

Δsel​\(s∣𝒮\)≔Lsel​\(𝒮∪\{s\}\)−Lsel​\(𝒮\)\.\\Delta\_\{\\mathrm\{sel\}\}\\left\(s\\mid\\mathcal\{S\}\\right\)\\coloneqq L\_\{\\mathrm\{sel\}\}\\left\(\\mathcal\{S\}\\cup\\\{s\\\}\\right\)\-L\_\{\\mathrm\{sel\}\}\(\\mathcal\{S\}\)\.\(65\)Adding a skill may increase coverage while also making selection more difficult\. Accordingly, test accuracy need not improve monotonically with skill\-set size\. A useful skill is one whose additional coverage exceeds any additional selection regret it introduces\.

The validation objective used byDIVEdirectly estimatesAagg​\(𝒮\)A\_\{\\mathrm\{agg\}\}\(\\mathcal\{S\}\)under the complete aggregation pipeline\. Its greedy marginal\-selection criterion therefore estimates the realized quantity in[Equation64](https://arxiv.org/html/2608.12486#A2.E64)\. Stopping when no remaining candidate yields positive validation improvement avoids adding skills whose incremental coverage does not compensate for their effect on candidate selection\.

Overall, independent populations improve the coverage of the evolved candidate pool, while joint validation\-based selection converts this search diversity into a compact set of instance\-level complementary skills\. The final benefit depends jointly on candidate competence, diversity in their error patterns, and the ability of the aggregation procedure to maintain low selection regret\.

HMMTQuestion:Mark writes the expressiona​b​c​d¯\\sqrt\{\\underline\{abcd\}\}on the board, wherea​b​c​d¯\\underline\{abcd\}is a four\-digit number anda≠0a\\neq 0\. Derek, a toddler, decides to move theaa, changing Mark’s expression toa​b​c​d¯a\\sqrt\{\\underline\{bcd\}\}\. Surprisingly, these two expressions are equal\. Compute the only possible four\-digit numbera​b​c​d¯\\underline\{abcd\}\.Answer:3375Question:TrapezoidA​B​C​DABCD, withA​B\|C​DAB\\\|CD, has side lengthsA​B=11,B​C=8,C​D=19AB=11,BC=8,CD=19, andD​A=4DA=4\. Compute the area of the convex quadrilateral whose vertices are the circumcenters of△​A​B​C,△​B​C​D\\triangle ABC,\\triangle BCD,△​C​D​A\\triangle CDA, and△​D​A​B\\triangle DAB\.Answer:9​159\\sqrt\{15\}Equational Theories\[Normal Set\]Question:You are a mathematician specializing in equational theories of magmas\.Your task is to determine whether Equation 1 \(x = x \* \(x \* \(\(y \* z\) \* z\)\)\) implies Equation 2 \(x = \(x \* x\) \* \(y \* \(z \* y\)\)\) over all magmas\.Output format \(use exact headers without any additional text or formatting\):VERDICT: must be exactly TRUE or FALSE \(in the same line\)\.REASONING: must be non\-empty\.PROOF: required if VERDICT is TRUE, empty otherwise\.COUNTEREXAMPLE: required if VERDICT is FALSE, empty otherwise\.Answer:False\[Hard Set\]Question:You are a mathematician specializing in equational theories of magmas\.Your task is to determine whether Equation 1 \(x = \(\(y \* y\) \* z\) \* x\) implies Equation 2 \(x = x \* \(\(\(y \* x\) \* x\) \* x\)\) over all magmas\.Output format \(use exact headers without any additional text or formatting\):VERDICT: must be exactly TRUE or FALSE \(in the same line\)\.REASONING: must be non\-empty\.PROOF: required if VERDICT is TRUE, empty otherwise\.COUNTEREXAMPLE: required if VERDICT is FALSE, empty otherwise\.Answer:TrueSudoku\[Normal Set\]Question:This is a standard 9x9 Sudoku, where X needs to be filled with digits 1\-9:X65XX821X7XX6X1X548X1X45673X42X7X19X9X8XX23651X6389XX2539X6XX216X4923XX7XX7154936Please complete this Sudoku\.Sudoku rules: Fill in digits 1\-9 so that each digit appears exactly once in each row, column, and 3x3 sub\-grid\.Please provide your answer at the end using a Python markdown code block, represented as a tuple, for example:‘‘‘python\(\(1,2,3,4,5,6,7,8,9\),\(4,5,6,7,8,9,1,2,3\),…\)‘‘‘Answer:\(\(4, 6, 5, 7, 3, 8, 2, 1, 9\), \(7, 2, 3, 6, 9, 1, 8, 5, 4\), \(8, 9, 1, 2, 4, 5, 6, 7, 3\), \(3, 4, 2, 5, 7, 6, 1, 9, 8\), \(9, 7, 8, 4, 1, 2, 3, 6, 5\), \(1, 5, 6, 3, 8, 9, 7, 4, 2\), \(5, 3, 9, 8, 6, 7, 4, 2, 1\), \(6, 1, 4, 9, 2, 3, 5, 8, 7\), \(2, 8, 7, 1, 5, 4, 9, 3, 6\)\)\[Hard Set\]Question:Try to solve this Sudoku, where X represents unknown digits:XX15X4X7XX48X9XXX55XXXXXX8XXX56XXXXXXXXXX37X8XX2XX14XXXX643XX2XXXXXXXXX9X7XX1583XPlease fill in all the Xs\.The rules of Sudoku are simple: each row, column, and 3x3 box must contain the numbers 1\-9 without repetition\.Please provide your answer at the end using a Python markdown code block, represented as a tuple, for example:‘‘‘python\(\(1,2,3,4,5,6,7,8,9\),\(4,5,6,7,8,9,1,2,3\),…\)‘‘‘Answer:\(\(3, 6, 1, 5, 8, 4, 9, 7, 2\), \(2, 4, 8, 3, 9, 7, 6, 1, 5\), \(5, 9, 7, 1, 6, 2, 3, 8, 4\), \(7, 3, 5, 6, 4, 8, 2, 9, 1\), \(6, 1, 4, 9, 2, 3, 7, 5, 8\), \(9, 8, 2, 7, 5, 1, 4, 6, 3\), \(8, 5, 6, 4, 3, 9, 1, 2, 7\), \(1, 2, 3, 8, 7, 6, 5, 4, 9\), \(4, 7, 9, 2, 1, 5, 8, 3, 6\)\)Cryptarithm\[Normal Set\]Question:In this alphametic puzzle: CTYYR \+ CRTC \+ RTT = CRYCT \(where CTYYR is 5\-digit number, CRTC is 4\-digit number, RTT is 3\-digit number, CRYCT is 5\-digit number\), each letter represents a distinct digit from 0\-9\. Determine the digits that make the equation valid\. Please end your response in the last line with the following format: The answer is $YOUR\_ANSWER\. $YOUR\_ANSWER should be the equation with letters replaced by digits\.Answer:16889 \+ 1961 \+ 966 = 19816\[Hard Set\]Question:In this verbal arithmetic problem: DZSQL \* DFQD \- DSZ \- LFDQ = FQDLQDFF \(where DZSQL is a 5\-digit number, DFQD is a 4\-digit number, DSZ is a 3\-digit number, LFDQ is a 4\-digit number, FQDLQDFF is a 8\-digit number\), substitute each letter with a unique digit to make the equation true\. Find the correct digit assignment\. Please end your response in the last line with the following format: The answer is $YOUR\_ANSWER\. $YOUR\_ANSWER should be the equation with letters replaced by digits\.Answer:20418 \* 2512 \- 240 \- 8521 = 51281255

## Appendix CDataset Statistics

In this section, we provide statistics for all benchmark datasets used in our study\. We evaluateDIVEon six mathematical and logical reasoning tasks: HMMT\([9](https://arxiv.org/html/2608.12486#bib.bib12)\), Equational Theories\([6](https://arxiv.org/html/2608.12486#bib.bib13)\), Sudoku, Cryptarithm, Calcudoku, and Futoshiki\([20](https://arxiv.org/html/2608.12486#bib.bib14)\)\.

HMMT is a prestigious high\-school mathematics competition featuring challenging problems in algebra, geometry, combinatorics, and number theory\. Because the official HMMT datasets do not include a training split, we construct one from NuminaMath\-1\.5\([19](https://arxiv.org/html/2608.12486#bib.bib41)\)by retaining valid, non\-synthetic, short\-answer competition problems from theolympiadsandamc\_aimesources\. We remove malformed and duplicate examples and exclude any problem with normalized overlap with the HMMT evaluation set, yielding 1,200 training problems\. For evaluation, we combine the MathArena HMMT February 2025 and November 2025 datasets\([9](https://arxiv.org/html/2608.12486#bib.bib12)\)\.

Equational Theories is a mathematical reasoning benchmark based on the Equational Theories Project\([6](https://arxiv.org/html/2608.12486#bib.bib13)\)and the SAIR Mathematics Distillation Challenge111https://competition\.sair\.foundation/competitions/mathematics\-distillation\-challenge\-equational\-theories\-stage1/overview\. Each problem presents two identities over a magma and asks whether the first equation logically implies the second over all possible magmas\. We construct the training set by merging the publicly available subsets from theSAIRfoundation/equational\-theories\-selected\-problemsdataset and removing all examples that appear in the evaluation benchmark, resulting in 1,400 training problems\. For evaluation, we use 400 problems from theSAIRfoundation/equational\-theories\-benchmarkdataset, comprising 200 normal and 200 hard problems\.

Sudoku, Cryptarithm, Calcudoku, and Futoshiki are synthetic logical reasoning tasks drawn from SynLogic\([20](https://arxiv.org/html/2608.12486#bib.bib14)\)\. For each task and difficulty setting, we use 1200 training instances and 200 test instances\. We construct normal and hard subsets using task\-specific generation parameters\. In the normal setting, Sudoku uses difficulty level 3; Cryptarithm uses four letters, two operators, and operator level 2; Calcudoku uses a5×55\\times 5grid; and Futoshiki uses a5×55\\times 5grid with 10 inequality signs and 5 prefilled cells\. In the hard setting, Sudoku uses difficulty level 4; Cryptarithm uses six letters, three operators, and operator level 3; Calcudoku uses a6×66\\times 6grid; and Futoshiki uses a6×66\\times 6grid with 14 inequality signs and 7 prefilled cells\.

We evaluate Qwen3\-8B on the normal subsets and all other models on the hard subsets\. HMMT contains a single evaluation set, which is used for all models\. Representative examples from each dataset are provided below\.

#### Verifiers\.

We implement dataset\-specific verifiers that reflect the structure and validity conditions of each task\. For HMMT, the verifier extracts and normalizes the final answer, then checks it against the reference using symbolic equivalence\. For Equational Theories, the response is parsed into the required verdict, reasoning, proof, and counterexample fields\. The normalized verdict is compared with the benchmark label\. For the SynLogic tasks, Sudoku, Cryptarithm, Calcudoku, and Futoshiki, we use task\-specific parsers and constraint checks\. Each verifier extracts the proposed solution, validates the required output format, and checks whether the solution satisfies the underlying task constraints\.

## Appendix DImplementation Details

For each dataset, we allocate1,0001\{,\}000training examples to the evolution set𝒟evo\\mathcal\{D\}\_\{\\mathrm\{evo\}\}and use the remaining as the validation set𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}\. We maintainK=10K=10independent populations\. For each populationkk, we independently bootstrap \(with replacement\) an experience subset𝒟exp\(k\)\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\}and a reflection subset𝒟ref\(k\)\\mathcal\{D\}\_\{\\mathrm\{ref\}\}^\{\(k\)\}from𝒟evo\\mathcal\{D\}\_\{\\mathrm\{evo\}\}, with\|𝒟exp\(k\)\|\|𝒟evo\|=0\.05\\frac\{\|\\mathcal\{D\}\_\{\\mathrm\{exp\}\}^\{\(k\)\}\|\}\{\|\\mathcal\{D\}\_\{\\mathrm\{evo\}\}\|\}=0\.05,\|𝒟ref\(k\)\|\|𝒟evo\|=0\.10\\frac\{\|\\mathcal\{D\}\_\{\\mathrm\{ref\}\}^\{\(k\)\}\|\}\{\|\\mathcal\{D\}\_\{\\mathrm\{evo\}\}\|\}=0\.10\.

Each population is initialized with\|𝒮0\(k\)\|=3\|\\mathcal\{S\}\_\{0\}^\{\(k\)\}\|=3seed skills and evolved for a budget ofB=10B=10steps\. At each evolution step, the proposed child skill is added to the current population without removing its parent skills\. Operators for which no eligible parents are available are excluded from UCB selection at that step\. We set the UCB exploration coefficient toβ=0\.3\\beta=0\.3and the parent\-sampling temperature toτp=0\.6\\tau\_\{\\mathrm\{p\}\}=0\.6\. Adaptive operator generation is performed at steptnew=8t\_\{\\mathrm\{new\}\}=8, at which pointNnew=1N\_\{\\mathrm\{new\}\}=1new operator is generated\. The Compression operator is applicable only to skills longer thanℓcomp=4,096\\ell\_\{\\mathrm\{comp\}\}=4\{,\}096tokens\. For Recombination, we set the trade\-off between individual performance and complementary coverage toλ=0\.5\\lambda=0\.5\. We use one rollout per skill–instance pair when evaluating skills on𝒟ref\\mathcal\{D\}\_\{\\mathrm\{ref\}\}and𝒟val\\mathcal\{D\}\_\{\\mathrm\{val\}\}\. Verifier\-labeled trajectories are partitioned into chunks that fit within the model context window; the chunks are summarized independently and then merged into a final summary\. To construct the final skill set, we retain the topL=3L=3skills from each population according to their individual validation performance and jointly select a set of at mostM=10M=10skills\. Greedy selection terminates either whenM=10M=10skills have been selected or when the largest remaining marginal improvement on the validation set is non\-positive\.

At inference time, models with native thinking or reasoning modes use their default reasoning configurations\. For models without such default configurations, we use a sampling temperature of0\.60\.6,top\_p=0\.95\\texttt\{top\\\_p\}=0\.95, and a maximum output length of32,76832\{,\}768tokens\. Unless otherwise stated, the same decoding configuration is used for skill initialization, evolution, summarization, operator generation, and inference\.

#### Baselines\.

For all baselines, we use the same decoding configuration asDIVE\. For few\-shot ICL\([7](https://arxiv.org/html/2608.12486#bib.bib16)\), we prepend a fixed set of 8 demonstrations sampled from training data\. Each demonstration consists of a question and its corresponding gold answer\. For SC\([33](https://arxiv.org/html/2608.12486#bib.bib2)\), we generateM=10M=10independent zero\-shot rollouts and select the final answer by majority vote\.

For ToT\([52](https://arxiv.org/html/2608.12486#bib.bib3)\), we implement it using breadth\-first search with search depthD=3D=3, branching factorb=3b=3, and beam widthw=2w=2\. At each depth, the model generates multiple distinct continuations for every retained partial solution\. The same model then jointly evaluates the resulting frontier and retains the top\-wwstates\. At the final depth, the retained states are converted into complete solutions, from which the model selects the strongest candidate\. For models with native reasoning modes, we use their default reasoning configurations for thought generation, state evaluation, and finalization\. The evaluator has no access to gold answers or verifier feedback\. To control test\-time computation, we count all thought\-generation, state\-evaluation, and finalization calls toward the ToT budget\. We match ToT to the number of model calls per instance ofDIVEwithM=10M=10\.

For experience RAG\([18](https://arxiv.org/html/2608.12486#bib.bib15)\), we first run the base model on the training set and record the resulting trajectories together with their verifier labels\. For each test instance, we compute its similarity to every training instance\. On HMMT, we usetext\-embedding\-3\-smallto compute semantic similarity\. For the remaining datasets, we use task\-specific symbolic similarity measures that better capture their structured problem formats\. We retrieve the 5 most similar training instances and provide the model with summaries of their verifier\-labeled trajectories\.

For ExpeL\([58](https://arxiv.org/html/2608.12486#bib.bib4)\), we adapt each benchmark as a one\-step verifiable environment in which a complete model response constitutes a trajectory\. During experience collection, the base model solves each training instance and, after an unsuccessful attempt, uses self\-reflection to generate up to three revised solutions; all verifier\-labeled failed trajectories and the first successful trajectory are retained\. Using the same base model as the reflection and insight\-extraction model, ExpeL contrasts successful and failed trajectories and aggregates patterns across successful trajectories to construct a task\-level memory of natural\-language rules\. At inference, we prepend the extracted rules and summaries of up to 5 successful training trajectories retrieved using the same similarity measures as experience RAG\.

For direct skill generation, we prompt the same base model to generate a task\-level skill using summaries of verifier\-labeled trajectories produced by that model on the training data\. At inference time, the generated skill is prepended to the model context\.

For SkillOpt\([48](https://arxiv.org/html/2608.12486#bib.bib46)\), we initialize the skill document with the task\-level skill produced by the direct\-skill baseline and treat this document as the trainable state while keeping the base model fixed\. At each optimization step, the base model performs rollouts on a minibatch of training instances, and the same model analyzes the verifier\-labeled trajectories to propose structured add, delete, or replace edits\. SkillOpt aggregates and ranks these edits, applies a bounded number of them according to its textual learning\-rate schedule, and accepts the resulting skill only when it strictly improves performance on the held\-out validation set\. We use the validation\-selected skill for test evaluation and never expose test instances or test feedback during optimization\. We match its optimization budget to that ofDIVE, follow the default SkillOpt configuration when applicable, and tune the remaining hyperparameters only on validation data\. At inference time, the optimized skill is prepended to the model context\.

For MIPROv2\([24](https://arxiv.org/html/2608.12486#bib.bib5)\), we jointly optimize the task\-level instruction and the selection of labeled demonstrations from the training data\. MIPROv2 first generates candidate instructions and demonstration sets, then applies Bayesian optimization to select the instruction–demonstration combination that maximizes validation accuracy\. We use the same base model as both the task model and instruction\-proposal model and allocate a rollout budget comparable to that ofDIVE\. For the remaining hyperparameters, we follow the default configuration when applicable and otherwise tune them exclusively on the validation data\.

For GEPA\([2](https://arxiv.org/html/2608.12486#bib.bib1)\), we use a rollout budget comparable to that ofDIVEand use the same base model as the reflection model\. For the remaining hyperparameters, we follow the default configuration when applicable and otherwise tune them on the validation data to ensure a fair comparison\.

#### Parameter\-based Adaptation\.

We further compareDIVEagainst parameter\-based adaptation methods using SFT and GRPO\([27](https://arxiv.org/html/2608.12486#bib.bib7)\)on Qwen3\-8B\([46](https://arxiv.org/html/2608.12486#bib.bib8)\)\. For SFT, we use the base model to generate multiple solution trajectories for each problem in the training set and apply rejection sampling, retaining only trajectories whose final answers are accepted by the verifier\. As the rollout budget increases, a single problem may therefore contribute multiple valid trajectories to the SFT dataset\. We perform parameter\-efficient fine\-tuning with LoRA\([16](https://arxiv.org/html/2608.12486#bib.bib42)\), which outperformed full\-parameter fine\-tuning on the validation split in our setting\. We set the LoRA rank tor=16r=16and scaling parameter toα=32\\alpha=32, apply LoRA to theq\_proj,k\_proj,v\_proj, ando\_projmodules, use no bias parameters, and set the LoRA dropout rate to0\.050\.05\. We optimize the trainable parameters using AdamW with linear warmup followed by cosine learning\-rate decay and a peak learning rate of2×10−42\\times 10^\{\-4\}\.

For GRPO, we perform full\-parameter policy optimization while maintaining a frozen copy of the base model as the reference policy\. We implement GRPO using the Verl framework\([28](https://arxiv.org/html/2608.12486#bib.bib43)\), with vLLM\([17](https://arxiv.org/html/2608.12486#bib.bib44)\)as the rollout backend\. Both the actor and reference policies are initialized from the same Qwen3\-8B checkpoint\. For each prompt, we sample a group ofN=8N=8candidate responses using a temperature of0\.70\.7andtop\_p=0\.9\\texttt\{top\\\_p\}=0\.9\. Each response receives a rule\-based outcome reward of11if its final answer is correct and00otherwise\. We optimize the actor using AdamW with a learning rate of1×10−61\\times 10^\{\-6\}and weight decay of0\.10\.1\. We additionally regularize the policy against the frozen reference using a KL penalty with coefficientλKL=0\.04\\lambda\_\{\\mathrm\{KL\}\}=0\.04\. Training usesbf16precision, gradient checkpointing, and FlashAttention2\([8](https://arxiv.org/html/2608.12486#bib.bib45)\)\. We train for three passes over the training set, evaluate every 10 optimization steps on the held\-out validation split, and select the checkpoint with the highest validation Pass@1\.

\(a\)HMMT, Qwen3\-8B\(b\)Sudoku, Qwen3\-8B
Figure 5:Hyperparameter tuning experiments for the per\-population evolution budgetBBon HMMT and Sudoku using Qwen3\-8B\. Here,B=0B=0corresponds to using only the seed skills without evolution\. Shaded regions indicate one standard deviation across independent runs\.\(a\)HMMT, Qwen3\-8B\(b\)Sudoku, Qwen3\-8B
Figure 6:Hyperparameter tuning experiments for the UCB coefficientβ\\betaon HMMT and Sudoku using Qwen3\-8B\. Shaded regions indicate one standard deviation across independent runs\.
\(c\)HMMT, Qwen3\-8B\(d\)Sudoku, Qwen3\-8B
Figure 7:Hyperparameter tuning experiments for the parent sampling temperatureτp\\tau\_\{\\mathrm\{p\}\}on HMMT and Sudoku using Qwen3\-8B\. Shaded regions indicate one standard deviation across runs\.

## Appendix EAdditional Results

In this section, we show hyperparameter tuning experiments and examples of the learned skills and representative model outputs\.

### Hyperparameter Tuning

We evaluate the sensitivity of our method to key hyperparameters including evolution budget, UCB coefficient, and parent\-sampling temperature\.

#### Evolution Budget\.

We study the effect of the per\-population evolution budgetBBon HMMT and Sudoku using Qwen3\-8B\. As shown in[Figure5](https://arxiv.org/html/2608.12486#A4.F5), performance generally improves as the evolution budget increases\. These results indicate that additional evolution steps enable the model to refine and diversify its skills, while the diminishing improvements at larger budgets suggest that most useful revisions have already been discovered\.

#### UCB Coefficient\.

We examine the effect of the UCB exploration coefficientβ\\beta, which controls the trade\-off between exploiting empirically effective evolution operators and exploring under\-evaluated alternatives\. As shown in[Figure7](https://arxiv.org/html/2608.12486#A4.F7), performance initially improves asβ\\betaincreases, reaching its highest level, and then declines\. Smaller values provide insufficient exploration and may cause the search to commit prematurely to operators favored by noisy early rewards, whereas larger values overemphasize exploration and allocate excessive budget to less productive operators\. The broad peak around moderate values indicates thatDIVEbenefits from balancing operator exploitation and exploration and is not overly sensitive to the precise choice ofβ\\beta\.

#### Parent\-sampling Temperature\.

We study the effect of the parent\-sampling temperatureτp\\tau\_\{\\mathrm\{p\}\}, which controls how strongly parent selection favors skills with higher operator\-specific scores\. As shown in[Figure7](https://arxiv.org/html/2608.12486#A4.F7), performance improves asτp\\tau\_\{\\mathrm\{p\}\}increases from zero, reaches its highest level at a moderate temperature, and then gradually declines\. Very small values make parent selection nearly deterministic, reducing diversity and repeatedly favoring a narrow set of skills, whereas larger values make the sampling distribution overly diffuse and weaken the operator\-specific selection preferences\. The broad peak suggests thatDIVEbenefits from maintaining a balance between selecting promising parents and preserving diversity during skill evolution\.

### Examples

We present the final skill set learned by GPT\-5\-nano on the HMMT and Sudoku datasets, together with representative model outputs under zero\-shot prompting andDIVE\. The learned skills exhibit both convergence and specialization: across independently evolved populations, GPT\-5\-nano consistently discovers a shared problem\-solving workflow, while individual skills emphasize complementary solution strategies and distinct sources of reasoning error\. The example outputs further illustrate that these evolved skills provide actionable guidance that enables the model to solve problems correctly\. Overall, the examples suggest that skill evolution extracts reusable problem\-solving principles while preserving diversity in how different failure modes are addressed\.

Calcudoku\[Normal Set\]Question:Here’s a Calcudoko puzzle for you\. You have an N×N grid with various regions\. Each region has a specific operation and target number\. Place numbers 1 to N in each row and column, ensuring no number appears twice in any row, column, or region\. For example, \(1,1\)\(2,1\)\(3,1\):12\+ means the numbers in those cells must add up to 12\.The size of the grid is 5×5\.\(\(3,4\),\(2,4\)\):5÷\(\(3,2\),\(2,2\)\):2÷\(\(2,5\),\(1,5\)\):1\-\(\(1,1\),\(2,1\),\(3,1\),\(4,1\)\):24\*\(\(1,2\),\(1,3\),\(1,4\)\):7\+\(\(5,5\),\(4,5\)\):1\-\(\(5,3\),\(4,3\),\(4,2\),\(5,2\)\):13\+\(\(4,4\),\(5,4\)\):1\-\(\(3,3\),\(2,3\)\):2\-\(\(3,5\),\(5,1\)\):2\-Please provide each element in order from left to right, and from top to bottom, with each element separated by a space and each row separated by a comma\. Ensure that your final answer is wrapped in double square brackets\.For example, if the answer is:A B CD E FG H Iplease output \[\[A B C,D E F,G H I\]\]\.Answer:\[\[3 1 2 4 5,1 2 3 5 4,2 4 5 1 3,4 5 1 3 2,5 3 4 2 1\]\]\[Hard Set\]Question:You are playing a Calcudoko puzzle on an N×N grid\. The grid is divided into regions, each with a target number and an operator\. Your task is to fill numbers 1 to N in each row and column, ensuring no number repeats in any row, column, or region\. For example, \(1,1\)\(2,1\)\(3,1\):12\+ means the sum of numbers in those cells must be 12\.The size of the grid is 6×6\.\(\(6,1\),\(5,1\)\):1\-\(\(3,1\),\(2,1\)\):1\-\(\(1,4\),\(2,4\),\(2,5\),\(1,5\)\):16\+\(\(5,5\),\(4,5\),\(3,5\)\):9\+\(\(5,4\),\(4,4\)\):3\-\(\(2,3\),\(3,3\)\):4÷\(\(6,6\),\(6,5\),\(6,4\)\):8\*\(\(3,6\),\(4,6\),\(5,6\)\):9\+\(\(6,3\),\(5,3\),\(4,3\)\):60\*\(\(4,1\),\(4,2\),\(5,2\)\):15\+\(\(2,6\),\(1,6\)\):1\-\(\(2,2\),\(3,2\)\):1\-\(\(1,1\),\(1,2\),\(1,3\)\):12\*\(\(3,4\),\(6,2\)\):2÷Please provide each element in order from left to right, and from top to bottom, with each element separated by a space and each row separated by a comma\. Ensure that your final answer is wrapped in double square brackets\.For example, if the answer is:A B CD E FG H Iplease output \[\[A B C,D E F,G H I\]\]\.Answer:\[\[1 4 3 5 2 6,2 1 4 3 6 5,3 2 1 6 5 4,4 5 6 1 3 2,5 6 2 4 1 3,6 3 5 2 4 1\]\]Futoshiki\[Normal Set\]Question:This is a 5x5 Futoshiki puzzle\. Game rules:1\. Fill in the n x n grid with numbers so that each row and column contains all numbers from 1 to n without repetition\.2\. There are inequality signs \(greater than "\>" or less than "<"\) between certain squares in the grid\. These inequality signs indicate the numerical relationship between two neighboring grids\. For example, if a grid has a "\>" sign above it, then the number of that grid must be greater than the number of the grid above it\.3\. Some grids will give pre\-filled numbers as hints\.4\. The questions are given as matrices and are accompanied by inequality constraints below in the form \(row i, column j\) \> \(row x, column y\)\.Current puzzle:X X 4 X X3 X 2 X XX X X 2 XX X X X X2 X X X XInequality constraints:\(3,3\) < \(4,3\)\(2,4\) \> \(3,4\)\(3,3\) < \(3,4\)\(2,1\) < \(3,1\)\(3,5\) \> \(4,5\)\(4,1\) \> \(5,1\)\(4,1\) < \(4,2\)\(1,1\) < \(2,1\)\(2,3\) \> \(3,3\)\(2,5\) \> \(3,5\)Please provide each element in order from left to right, and from top to bottom, with each element separated by a space and each row separated by a comma\. Ensure that your final answer is wrapped in double square brackets\.For example, if the answer is:A B CD E FG H Iplease output \[\[A B C,D E F,G H I\]\]\.Solving tips:1\. Analyze the inequality constraints to find possible number ranges\.2\. Use pre\-filled numbers and inequality relationships to gradually deduce other positions\.3\. Remember that numbers cannot repeat in each row and column\.Answer:\[\[1 2 4 5 3,3 1 2 4 5,5 3 1 2 4,4 5 3 1 2,2 4 5 3 1\]\]Futoshiki \(continued\)\[Hard Set\]Question:This is a 6x6 Futoshiki puzzle\. Rules:1\. Fill in the n x n grid with numbers so that each row and column contains all numbers from 1 to n without repetition\.2\. There are inequality signs \(greater than "\>" or less than "<"\) between certain squares in the grid\. These inequality signs indicate the numerical relationship between two neighboring grids\. For example, if a grid has a "\>" sign above it, then the number of that grid must be greater than the number of the grid above it\.3\. Some grids will give pre\-filled numbers as hints\.4\. The questions are given as matrices and are accompanied by inequality constraints below in the form \(row i, column j\) \> \(row x, column y\)\.Current puzzle:X X X 1 X XX X X X 1 2X 5 X X X XX X X X 3 XX X X X X X3 X X 2 X XInequality constraints:\(2,5\) < \(2,6\)\(2,5\) < \(3,5\)\(4,5\) < \(5,5\)\(3,4\) < \(4,4\)\(2,2\) \> \(2,3\)\(5,1\) \> \(5,2\)\(4,1\) < \(5,1\)\(3,2\) < \(3,3\)\(6,4\) < \(6,5\)\(3,3\) \> \(3,4\)\(5,5\) < \(6,5\)\(5,2\) \> \(5,3\)\(5,3\) < \(5,4\)\(6,1\) \> \(6,2\)Please provide each element in order from left to right, and from top to bottom, with each element separated by a space and each row separated by a comma\. Ensure that your final answer is wrapped in double square brackets\.For example, if the answer is:A B CD E FG H Iplease output \[\[A B C,D E F,G H I\]\]\.Solving tips:1\. First analyze the inequality constraints to determine possible number ranges for certain cells\.2\. Combine pre\-filled numbers and inequality relationships to gradually deduce other positions\.3\. Remember that numbers cannot repeat in each row and column\.Answer:\[\[4, 2, 3, 1, 5, 6\], \[5, 6, 4, 3, 1, 2\], \[1, 5, 6, 4, 2, 3\], \[2, 4, 1, 6, 3, 5\], \[6, 3, 2, 5, 4, 1\], \[3, 1, 5, 2, 6, 4\]\]HMMT\-GPT\-5\-nano\-Skill\-1\# Solve Competition Math ProblemsSolve one problem completely\. Favor a concrete representation and auditable equations over a clever but unsupported claim\. Preserve enough output budget to state a final answer\.\#\# Output contract\- End with exactly one ‘\\boxed\{…\}‘ containing only the requested value\.\- Use exact arithmetic\. Reduce fractions and radicals; do not use decimals\.\- Do not leave free variables, units, prose, spacing macros, or ‘\\left‘/‘\\right‘ inside the box\.\- Never return an empty response or a bare answer\. Show the equations or count that determine the value\.\- If the main approach becomes long, stop expanding prose, finish the essential calculation, perform one check, and box the result\.\#\# Core workflow1\. \*\*Parse literally\.\*\* Record the target, all constraints, and the exact structure of the input\. For a repeated string, write its true period; for simultaneous dynamics, write the state after one and two updates; for a diagram, label coordinates or variables\.2\. \*\*Choose a representation\.\*\* Use a bijection or recurrence for counting, indicator variables for expectation, gcd/lcm inclusion\-exclusion for periodic events, coordinates or vectors for geometry, and frontier states for grid Hamiltonian paths\.3\. \*\*Derive before evaluating\.\*\* State the formula that counts or determines the target\. Do not infer a numeric probability from symmetry and do not infer a count from a picture\.4\. \*\*Audit locally\.\*\* Test a tiny instance, a boundary case, or one recurrence step by direct enumeration\.5\. \*\*Audit globally\.\*\* Check scale, symmetry, positivity, dimensions, and whether every independent choice or branch was included exactly once\.6\. \*\*Finish\.\*\* Simplify the exact expression and emit one boxed answer\.\#\# High\-value failure checks\#\#\# Counting and dynamic programming\- Define what one counted object is and whether labels, order, orientation, rotation, or reflection matter\.\- After finding a structural skeleton, list the residual choices\. Multiply independent binary choices, permutations, placements, and orientations; prove that the parameterization is both injective and surjective\.\- For a subsequence DP, update once per actual character from high prefix length to low prefix length\. Never replace a period such as ‘SUN‘ by an overlapping block such as ‘SUNS‘\. Verify the first one or two periods by listing subsequences\.\- For a large grid path count, do not extrapolate from a drawing\. Use a column\-by\-column frontier DP or a recurrence whose state records occupied boundary vertices, degrees, and connectivity\. Reject premature cycles and require one final connected path with the specified endpoints\.\- For cyclic or simultaneous processes, first derive the value at timettfrom the original state\. Count surviving original labels with indicators; account for overlapping windows instead of assuming independence\.\#\#\# Probability and symmetry\- Symmetry proves equal probabilities only within the same orbit\. It does not make different event classes equiprobable\.\- When two random points determine a line or chord, the induced line distribution is not uniform in direction, offset, or edge pair\. Parameterize the two points directly, or integrate lines with the correct chord\-length\-squared weight\.\- Partition the full sample space into disjoint geometric cases and compute their areas or integrals\. Confirm that all case probabilities sum to11\.\- For expectations, prefer linearity with indicators even when events are dependent\. Derive the indicator event exactly before evaluating its probability\.\#\#\# Periodic events and number theory\- Translate “moments with at least one/two/three events” using inclusion\-exclusion\.\- If processes completea,b,ca,b,ccycles in a common interval, pairwise coincidences are governed by gcd values, while union counts follow inclusion\-exclusion\. Write the symmetric equations before searching integer solutions\.\- Enforce divisibility, positivity, parity, and ordering constraints during the search; substitute the candidate back into every count\.\#\#\# Geometry\- Never answer geometry from visual plausibility\. Introduce coordinates, vectors, complex numbers, or exact trigonometry and show the equations used\.\- For circles and tangents, exploit radical axes, powers, homothety centers, and distances to lines\. Check which tangent, intersection, or arc is intended\.\- For a plane section of a box or prism, write the plane in intercept or normal form\. Express section\-edge lengths through direction vectors, solve the resulting system, and compute the center\-to\-plane distance with the normalized normal vector\.\- Track branch and sign conditions for radical expressions\. Check the final length against triangle inequalities and the scale of the diagram\.\#\# Mandatory pre\-box auditAnswer these briefly before boxing:\- What exact equation, recurrence, bijection, or integral produced the value?\- Did any symmetry argument compare different orbits or ignore a nonuniform measure?\- Did any DP modify the literal input pattern or update states in the wrong order?\- Did the count include every independent choice and exclude every duplicate?\- Does a small case or substitution agree?\- Is the result exact, simplified, fully evaluated, and the quantity actually requested?HMMT\-GPT\-5\-nano\-Skill\-2\# Solve Competition Math ProblemsSolve the problem, not a remembered answer pattern\. Use exact arithmetic and make every decisive step auditable\. Budget the response so the derivation, one verification, and the final answer all fit\.\#\# Output contract\- End with exactly one ‘\\boxed\{…\}‘ containing only the requested value\.\- Give a compact derivation before the box\. Never apologize, refuse, guess, or return an empty response\.\- Use exact simplified arithmetic: reduced fractions, simplified radicals, and fully evaluated integers or expressions\.\- Put no prose, units, free variables, decimal approximations, or delimiter/spacing macros inside the box\.\- If time or tokens become tight, stop exposition, write the determining equations, verify the candidate by substitution, and box it\.\#\# Solve–audit workflow1\. \*\*Parse literally\.\*\* Record the target, order conditions, interior/acute constraints, labels, simultaneity, and whether reflections or orientations are distinct\.2\. \*\*Build a concrete model\.\*\* Prefer coordinates or vectors for geometry, indicators or weighted integrals for probability, bijections or state recurrences for counting, and prime\-exponent vectors for divisor problems\.3\. \*\*Derive before calculating\.\*\* Write the exact equation, recurrence, bijection, or integral that determines the answer\.4\. \*\*Enumerate branches\.\*\* List all configurations allowed algebraically or by the diagram\. Reject a branch only by citing a stated constraint\.5\. \*\*Calculate without black boxes\.\*\* Do not write “standard consistency,” “straightforward substitution,” or “it reduces to” at the step that determines the answer\. Show that reduction\.6\. \*\*Verify with a witness\.\*\* Substitute the result into the original conditions, reconstruct the configuration, or test the recurrence on a small instance\.7\. \*\*Audit scale and completeness\.\*\* Check bounds, signs, dimensions, symmetry, omitted choices, duplicates, and whether the requested quantity—not an auxiliary one—was found\.8\. \*\*Finish immediately\.\*\* Simplify and emit the single boxed value\.\#\# Geometry guardrails\- Do not trust the apparent orientation\. In coordinates, explicitly choose signs for points above/below a baseline and retain the choice satisfying “inside,” vertex order, acute\-angle, or intersection conditions\. An equilateral triangle erected on an internal segment may point opposite the containing triangle\.\- Convert every qualitative condition into a test:\- inside a triangle: barycentric coordinates or same\-side inequalities;\- acute: all three relevant dot products are positive;\- angleθ\\theta: use both dot\-product and cross\-product signs, not cosine alone;\- “again atXX”: exclude the known intersection and check the selected root\.\- When squaring, using a cosine equation, or eliminating radicals, keep every algebraic root until sign and location constraints reject it\.\- For circles and tangents, use powers, radical axes, homothety centers, distances to tangent lines, and chord equations before expanding coordinates\.\- For a rectangular\-prism plane section, pair opposite parallel sides of the hexagon\. Represent the plane by a normal or intercept equation, derive the box dimensions from the six section edges, then divide by the normal’s magnitude when computing distance\. Verify all six cyclic side lengths\.\- For a computed length, check positivity, triangle inequalities, and rough geometric scale\. A coordinate result is not verified merely because its arithmetic is internally consistent\.\#\# Counting and structural classification\- Define precisely what counts as one object\. State whether labels, order, orientation, reflection, and the order of cuts matter\.\- Prove the structural classification is exhaustive before counting its cases\. For rectangle dissections, grid paths, or word arrangements, a picture showing some families is not an exhaustion proof\.\- After deriving a skeleton, list every residual independent choice\. Look specifically for per\-gap or per\-boundary binary choices that produce a factor2k2^\{k\}, not a single global factor22\.\- Establish both directions of a parameterization:1\. every valid object yields the parameters;2\. every allowed parameter choice yields one valid object;3\. two parameter choices do not encode the same object\.\- Perform a mandatory small\-case check\. Enumerate the first nontrivial size by hand or with a short table; reject a recurrence whose base case or next value disagrees\.\#\#\# Grid Hamiltonian paths\- Never “peel” columns unless the remainder has exactly the same boundary state\.\- Use frontier states recording each exposed vertex’s degree and connectivity\. Reject degree\>2\>2, premature closed cycles, disconnected sealed components, and invalid endpoint degrees\.\- Accept only a final single component visiting every cell, with the prescribed endpoints of degree11and all others of degree22\.\#\# Probability, expectation, and dynamics\- Use linearity of expectation without claiming the indicator events are independent\.\- For simultaneous local updates, prove the state afterttsteps directly from the original state, usually by induction\. Then characterize exactly when an original label appears in at least one final window\.\- Events from overlapping sliding windows are highly dependent\. Never replace a union of window\-maximum events by1−\(1−p\)m1\-\(1\-p\)^\{m\}unless independence has been proved\.HMMT\-GPT\-5\-nano\-Skill\-2 \(continued\)\- Analyze survival using nearest larger elements, cyclic gaps, records, or a direct permutation count\. Check the formula on a tiny circle by enumerating relative rankings\.\- For a line determined by two uniform random points, the induced line is not uniform in angle, offset, or edge pair\. Integrate over the ordered point pair or use the correct chord\-length\-squared weighting\. Partition the complete sample space and verify probabilities sum to11\.\- Symmetry gives equal probabilities only for cases in the same orbit; identify the symmetry action before equating cases\.\#\# Number theory and periodic events\- For divisor thresholds, use the involutiond↔n/dd\\leftrightarrow n/dwith strict inequalities handled exactly\. Count all small divisors of the full candidate, including products involving any added primes; “choose new primes above the threshold” alone does not prevent mixed products from being small\.\- Optimize over realizable exponent vectors\. A divisor count must factor as∏\(ei\+1\)\\prod\(e\_\{i\}\+1\); do not assume every nearby multiple is attainable while preserving the small\-divisor count\.\- For periodic coincidences over a common interval, count individual event sets, pairwise intersections using gcd values, and the triple intersection using the common gcd\. Translate “at least one,” “at least two,” and “all three” into exact inclusion\-exclusion equations\.\- Enforce positivity, integrality, divisibility, ordering, and strict inequalities during the search, then substitute the candidate into every original count\.\#\# Algebra, recurrences, and named sequences\- Preserve domains when taking logarithms, squaring, dividing, or applying floors\. Pair floor terms only after checking integer boundary cases\.\- For polynomial interpolation at consecutive integers, consider finite differences and products that vanish at all given nodes before expanding coefficients\.\- For a named sequence, write its definition and indexing convention before evaluating\. Compute a table sequentially; do not rely on memory when indexing may start at00or11\.\- For a subsequence recurrence, process each literal character once and update prefix lengths from high to low\. Do not silently change a period into an overlapping block\.\#\# Mandatory pre\-box auditAnswer these internally before boxing:\- What exact displayed relation determines the value?\- Were all orientation, sign, and algebraic branches tested against the statement?\- Did a symmetry or independence claim compare genuinely equivalent events?\- Is the counting classification exhaustive, and are all residual choices included?\- Does a small case, substitution, or reconstructed witness validate the result?\- Is the final expression exact, simplified, and the quantity requested?If any answer is “no,” repair that point before emitting ‘\\boxed\{…\}‘\.HMMT\-GPT\-5\-nano\-Skill\-3\# Solve Competition Math ProblemsSolve one problem from its literal statement\. Prefer a complete elementary derivation over a polished outline\. Spend tokens on equations and finite counts, not on restating the prompt\.\#\# Enforce the output contract\- End with exactly one ‘\\boxed\{…\}‘ containing only the requested value\.\- Use an exact, simplified form\. Prefer ‘\\frac\{…\}\{…\}‘ to a decimal and remove decorative spacing commands\.\- Show the equation, recurrence, integral, or exhaustive count that produces the value\.\- Never emit an empty response, a bare guess, or phrases such as “a standard argument gives” in place of computation\.\- Reserve the final 15 percent of the response budget for completing the calculation, checking it, and boxing it\. If work grows long, compress prose rather than abandoning the answer\.\#\# Follow this workflow1\. \*\*Lock onto the problem\.\*\* Write a one\-line target signature: objects, supplied constants, constraints, and requested quantity\. Before boxing, confirm the derivation used those same objects and constants\.2\. \*\*Choose a concrete model\.\*\* Use coordinates or vectors for geometry; indicators or an explicit integral for probability; residue classes or inclusion\-exclusion for arithmetic counts; a state recurrence for paths and sequences\.3\. \*\*Derive before evaluating\.\*\* State every decisive relation\. Treat an unexplained numerical subtotal as uncomputed\.4\. \*\*Keep all branches\.\*\* Record sign, orientation, arc, tangent, and ordering conditions\. Reject a branch only by substituting it into the original constraints\.5\. \*\*Audit locally\.\*\* Check a tiny instance, one transition, or one coordinate relation\.6\. \*\*Audit globally\.\*\* Check scale, parity, bounds, dimensions, total probability, and omitted independent choices\.7\. \*\*Finish early enough\.\*\* Once a valid exact expression is obtained, simplify, verify once, and box it\.\#\# Refuse unreliable shortcuts\- Do not infer a probability merely by counting symmetry classes\. Symmetry equates cases in the same orbit; it does not prove different edge\-pair or line classes have equal measure\.\- Do not cite a “standard observation” unless it is derived in the response and dimensionally consistent\.HMMT\-GPT\-5\-nano\-Skill\-3 \(continued\)\- Do not report that backtracking, casework, or inclusion\-exclusion “gives” a number\. Display the recurrence, case table, or arithmetic subtotals\.\- Do not use a diagram as evidence that points are centered, collinear, ordered, or on a particular arc\.\- Do not regard a necessary parity or coloring condition as sufficient\.\- Do not conclude that a recursive/nested arrangement is impossible from an informal infinite\-descent story\. Exhibit the descent map and a strictly decreasing finite parameter, or test small alphabets and revise the structure\.\#\# Use exact counting\#\#\# Finite paths and tilings\- Define a state precisely\. For a small board, useF⁡\(v,S\)F\(v,S\): number of continuations from current vertexvvwith visited setSS\. Sum over legal unvisited neighbors, withF⁡\(t,S\)=1F\(t,S\)=1only when the stopping condition is satisfied\.\- For a long narrow Hamiltonian grid, scan column by column\. Record occupied frontier vertices, their degrees, connectivity pairings, and endpoint status\. Reject degree above 2, premature cycles, sealed components, and early arrival at the target\. Accept only one connected path using every cell\.\- For rectangle dissections, classify by the full cut that must exist: two parallel full cuts, or one full cut followed by one perpendicular cut in either resulting piece\. Count cut coordinates and orientations explicitly; ensure equivalent construction orders are not double\-counted\.\- Use a direct table or short program when tools are available, but include enough recurrence detail that the count is reproducible\.\#\#\# Arrangements and subsequences\- After finding a structural skeleton, list every independent order, orientation, side choice, labeling, and placement\. Multiply only after proving choices are independent and unique\.\- Test a claimed classification on one and two labels\. Nested or interleaved solutions often create a binary choice at each insertion; do not assume all three copies of a letter must be consecutive\.\- For subsequences, process the literal source string one character at a time and update target\-prefix counts from high index to low index\. Verify the first repeated block by hand\.\#\#\# Arithmetic sets\- For conditions such asa\+b=ca\+b=cwith forbidden residue classes, count allowed ordered pairs directly:∑c=1N∑a=1c−1\[a∈S\]\[c−a∈S\]\[c∈S\]\.\\sum\_\{c=1\}^\{N\}\\sum\_\{a=1\}^\{c\-1\}\[a\\in S\]\[c\-a\\in S\]\[c\\in S\]\.Evaluate by residue classes or a displayed inclusion\-exclusion table\. Compute all intersections; never replace the last subtotal by “standard finite computations\.”\- Preserve “ordered,” strict endpoint bounds, and whether zero belongs to the set\.\#\# Use probability measures correctly\- Start from the actual experiment: independently uniform points are not a uniformly random direction, chord, offset, or pair of boundary edges\.\- For two points in a convex region, either integrate directly over the point pair or use the affine Blaschke–Petkantschin change of variables\. Under invariant line measure, the ordered point\-pair weight of a chord of lengthℓ\\ellis proportional to∫0ℓ∫0ℓ\|s−t\|​𝑑s​𝑑t=ℓ3/3\\int\_\{0\}^\{\\ell\}\\int\_\{0\}^\{\\ell\}\|s\-t\|\\,ds\\,dt=\\ell^\{3\}/3, not merely the number of chords\.\- Partition lines or point pairs into disjoint geometric regions, integrate each region exactly, and check that favorable plus unfavorable weights equal the total\.\- For expectation, use indicators\. For a simultaneous cyclic maximum process, first prove the time\-ttvalue is the maximum over the appropriate original cyclic window\. Characterize when an original label appears in at least one final window using nearest\-larger gaps or relative ranks; account for overlapping windows and verifyt=0t=0andt=1t=1\.\#\# Make geometry algebraic\- Assign coordinates consistent with only the stated incidences\. Translate perpendicularity to dot products, concyclicity to equal powers or a circle equation, and tangency to a center\-line distance\.\- For nested tangent semicircles, allow the inner diameter chord to be off\-center and tilted unless parallelism is stated\. Parameterize each center and radius; impose chord endpoints on the outer circle and arc\-to\-diameter tangency\. Do not place a tangency point at the outer midpoint without deriving it\.\- For two circles and common external tangents, use the external homothety center and distances to both tangent lines\. Relate the common chord to the radical axis; compute the requested tangent quadrilateral as a trapezoid from its two parallel side lengths and separation\.\- For a fixed chord subtending an angle, distinguish the two possible circle arcs and whether the inscribed angle is the minor\-arc or major\-arc branch\. After solving coordinates, enforce that the requested point lies inside the stated region\.\- For a circle\-with\-diameter condition, use the right angle exactly\. Recompute any quadratic discriminant from the expanded equation, substitute the chosen root back, and compare all roots with interior/order constraints\.\- For a plane cutting a rectangular prism, represent the plane by a normalized normal and represent the six section edges as vectors on the six faces\. Use vector closure and opposite\-face translations to recover the prism dimensions and plane offset\. Never average section side lengths: a length cannot equal a center\-to\-plane distance without a proved relation\.\- Check the final length or area against triangle inequalities, bounding shapes, and the scale of all supplied lengths\.\#\# Perform the pre\-box auditConfirm all of the following:\- The solution addresses the target signature and uses the given constants\.\- Every decisive numerical subtotal is reproducible from displayed work\.\- No symmetry argument silently changed the probability measure\.\- Every count includes all independent choices and no duplicate objects\.\- Every geometric branch satisfies the original incidence, order, acuteness, and interior conditions\.\- A small case, substitution, recurrence step, or independent estimate agrees\.\- The response is complete and ends in one exact boxed value\.HMMT\-GPT\-5\-nano\-Skill\-4\# Solve Competition Math ProblemsProduce a finished contest solution\. Prefer a plain, auditable derivation over a clever claim\. Never refuse a finite calculation, ask permission to continue, or leave the response empty\.\#\# Enforce the answer contract\- End with exactly one ‘\\boxed\{…\}‘ and no text after it\.\- Put only the requested value in the box\.\- Use exact, simplified notation: integers, ‘\\frac\{a\}\{b\}‘, radicals, powers, and standard constants\.\- Use ‘\\frac‘, not ‘\\tfrac‘; omit ‘\\,‘, ‘\\¡, ‘\\left‘, ‘\\right‘, ‘\\text‘, units, and prose from the box\.\- Normalize equivalent forms before boxing\. Prefer ‘\\sqrt\{…\}\-…‘ to a spaced variant and ‘\\sqrt\{\\frac\{…\}\{…\}\}‘ to an unsimplified expression\.\- Give a derivation before the box\. If time or output is tight, compress prose and preserve the decisive equations, one check, and the answer\.\#\# Follow this workflow1\. \*\*Parse\.\*\* State the target, domains, order conditions, strict inequalities, and whether objects are labeled or ordered\.2\. \*\*Represent\.\*\* Introduce coordinates, indicators, residue classes, a recurrence, or a finite state\. Do not reason from a picture alone\.3\. \*\*Derive\.\*\* Establish the equation or bijection before inserting numbers\.4\. \*\*Resolve branches\.\*\* Track signs, orientations, roots introduced by squaring, and geometric point order\.5\. \*\*Audit\.\*\* Check a small case, substitute into the original conditions, or recompute by a second short route\.6\. \*\*Canonicalize and box\.\*\*If an approach becomes unwieldy, change representations\. Do not replace the missing derivation with “straightforward computation,” “standard fact,” “natural symmetric possibility,” or an asserted local pattern\.\#\# Counting and finite\-state problems\#\#\# Complete finite enumeration without refusing\- For a bounded walk, define ‘F\(position, visited\-set\)‘ as the number of completions\. UseF⁡\(v,S\)=∑w​legal from​vw∉SF⁡\(w,S∪\{w\}\),F\(v,S\)=\\sum\_\{\\begin\{subarray\}\{c\}w\\text\{ legal from \}v\\\\ w\\notin S\\end\{subarray\}\}F\(w,S\\cup\\\{w\\\}\),with ‘F\(target,S\)=1‘ only when all required conditions are met\.\- Reduce states using a frontier or transfer recurrence when the board is long and narrow\. Record occupied frontier vertices, their degrees, and connectivity; reject degree violations, premature cycles, and disconnected sealed components\.\- Do not decompose a Hamiltonian path into independent blocks unless every crossing pattern and connectivity state at each boundary has been classified\. A “two patterns per block” picture is not a proof\.\- Show enough recurrence values, case totals, or a transfer table to make the final count reproducible\. Never merely offer code or ask whether computer assistance is acceptable\.\#\#\# Prove the combinatorial structure\- Define exactly what a counted object is\. Decide whether order, labels, rotations, or reflections distinguish it\.\- For every parameterization, prove both directions: every parameter choice gives a valid object, and every valid object appears exactly once\.\- After choosing a pivot object, ask whether each finished object is counted again for other pivots\. Never say “by symmetry, counted once\.”\- Treat an observed symmetric construction as a lower bound until alternatives are excluded\.\- For interval\-balance conditions on three occurrences of each symbol, encode each other symbol by its counts in the four gaps\. Apply the condition with both symbols as pivots\. Derive the global recursive classification before multiplying orders and binary choices\.\#\#\# Use indicators for expectations\- Write the requested count as a sum of indicators and compute each survival or avoidance probability\.\- Dependence among indicators does not prevent linearity of expectation\.\- For a path and one uniformly blocked cell, count path\-cell incidences or compute each path’s probability of avoiding the blocker; include blocked endpoints exactly as stated\.\#\# Probability and geometric measure\- Do not infer probabilities among geometric line types from rotational or dihedral symmetry unless the types lie in one orbit under the sample distribution\.\- When two uniform points determine a line, lines are not uniform in direction or offset\. Parameterize the two points directly, or parameterize lines and include the chord\-length\-squared weight from choosing two points on the chord\.\- For a polygon, partition by the pair of boundary edges hit, integrate or compare the corresponding weighted regions, and verify that all disjoint cases total the full sample space\.\- Never emit a bare guessed probability\. State the sample\-space measure and favorable measure\.\#\# Number theory and divisor thresholds\- Convert a percentage statement to an integer inequality before optimizing\. Preserve “strictly more than\.”\- Pair divisors by ‘d \-\> n/d‘\. For the threshold ‘d<n/100‘, count complementary divisors greater than ‘100‘; handle the boundary divisor ‘100‘ separately\.\- If ‘q\(n\)‘ is the number of divisors of ‘n‘ at most ‘100‘ and ‘t=\\tau\(n\)‘, then the number below ‘n/100‘ is ‘t\-q\(n\)‘\. Reduce the imbalance condition from this exact identity before searching exponent patterns\.HMMT\-GPT\-5\-nano\-Skill\-4 \(continued\)\- Do not assume that using only the primes already forced by divisibility minimizes ‘\\tau\(n\)‘\. Enumerate feasible exponent\-factor patterns for ‘t‘, use ‘q\(n\)‘ to rule them out, and provide a construction attaining the minimum\.\- In modular pair counts with an inequality such as ‘a\+b<N‘, count residue classes together with their truncated quotient ranges\. Check every exclusion boundary directly; one incorrect table entry changes the result\.\- Cross\-check ordered\-pair counts by summing over the possible value of ‘c=a\+b‘ or by an equivalent inclusion\-exclusion formula\.\#\# Geometry: branch\-safe analytic method\#\#\# Set coordinates from incidences\- Encode collinearity, betweenness, and orientation explicitly\. “D lies between E and C” determines a signed coordinate, not just a distance\.\- For an isosceles trapezoid represented by parallel chords of a circle, enumerate whether the chords lie on the same or opposite sides of the center and which endpoint label corresponds under reflection\. Reject branches only after testing all order and length constraints\.\- When a midpoint must also lie on a circle, substitute its coordinates before simplifying\. If a computed squared length is negative, revisit orientation and label branches; do not conclude that the stated contest configuration is impossible from one coordinate placement\.\- After squaring an angle or distance equation, substitute every root into the unsquared equation and test interior/acute conditions\.\#\#\# Use exact circle relations\- Translate “circle with diameter ‘AB‘” to ‘∠​A​X​B=90∘\\angle AXB=90^\{\\circ\}‘ or ‘\(X−A\)⋅\(X−B\)=0\(X\-A\)\\cdot\(X\-B\)=0‘\.\- Translate a circumradius withR=a​b​c4​K=opposite side2​sin⁡\(opposite angle\)\.R=\\frac\{abc\}\{4K\}=\\frac\{\\text\{opposite side\}\}\{2\\sin\(\\text\{opposite angle\}\)\}\.Use the acute\-triangle hypotheses to choose signs of sines, projections, and square roots\.\- For two intersecting circles with common external tangents, use the external homothety center and the common chord/radical axis\. In a wedge formed by the tangents, a circle tangent to both lines has center on an angle bisector and radius proportional to its distance from the vertex\. Express the given point\-to\-line distances in the same coordinates and derive the tangent quadrilateral’s area\.\- For an angle condition such as ‘∠​B​X​C=120∘\\angle BXC=120^\{\\circ\}‘, retain\(B−X\)⋅\(C−X\)=−12​\|B−X\|​\|C−X\|\(B\-X\)\\cdot\(C\-X\)=\-\\frac\{1\}\{2\}\|B\-X\|\|C\-X\|and enforce the negative sign after any squaring\. Test that ‘X‘ lies inside the required region\.\#\#\# Do not invent prism\-section identities\- In a plane section of a rectangular prism, first note that consecutive section sides lie alternately in the three coordinate\-face directions; opposite sides are parallel but need not have equal lengths\.\- Use vector closure of the hexagon and the three direction vectors determined by the plane normal\. Relate signed differences of opposite side lengths to the prism edge vectors and the plane offset\.\- Derive the distance from the center using the normalized plane equation\. It is not generally half the space diagonal\.\- Verify vector closure with all six given lengths and check that the resulting plane actually intersects all six faces\.\#\# Algebra and recurrence checks\- Preserve literal indexing conventions for named or recursively defined sequences\. Compute a short table from the definition rather than recalling values from memory\.\- For symmetric algebraic systems, subtract pairs of equations and use distinctness to divide only after displaying the nonzero factor\.\- For floors, signs, logarithms, or interpolation modulo a prime, pair terms or transform the entire sum before evaluating; check endpoints and exceptional zeros\.\- For a proposed polynomial or radical solution, substitute into the original equation, not only a squared or reduced form\.\#\# Mandatory final auditBefore boxing, verify:\- A displayed equation, recurrence, integral, or bijection determines the value\.\- No finite problem was deferred and no answer is blank\.\- Every case, orientation, independent choice, and duplicate count is handled\.\- No unproved symmetry, local\-block independence, or “standard fact” carries the result\.\- Strict inequalities and boundary objects are correct\.\- The value satisfies the original conditions and a scale or small\-case check\.\- The box contains canonical exact LaTeX and nothing else\.HMMT\-GPT\-5\-nano\-Skill\-5\# Solve Competition Math ProblemsProduce a complete solution to one problem\. Prefer an explicit equation, bijection, recurrence, or coordinate model over an elegant\-sounding assertion\.\#\# Preserve the answer\- Reserve enough output for the final calculation and answer before developing the proof\.\- If an approach grows unwieldy, stop the exposition, retain only essential equations, switch to a finite table or recurrence, and finish\.\- Never return an empty response\. If a full proof is too long, give the decisive derivation and the exact result\.\- End with exactly one ‘\\boxed\{…\}‘ containing only the requested value\.\- Use exact simplified arithmetic\. Avoid prose, units, ‘\\text‘, and unevaluated expressions inside the box\.\#\# Execute this workflow1\. Parse the literal statement\. Record the target, labels, order of vertices or events, simultaneous versus sequential actions, and whether objects are labeled or ordered\.2\. Choose a concrete model:\- algebra: coefficient equations, conjugates, or interpolation;\- counting: a bijection, inclusion\-exclusion, or a recurrence with a defined state;\- probability: indicators or integration over the original random variables;\- geometry: coordinates, vectors, powers, or exact trigonometry;\- number theory: residues, gcd/lcm identities, or divisor parameterization\.3\. Derive the governing formula before substituting numbers\.4\. Check one small case, boundary case, alternate orientation, or direct substitution\.5\. Audit missing cases, duplicate counts, independent choices, signs, and scale\.6\. Simplify and box the quantity actually requested\.Do not invoke a “standard fact” unless deriving it in the notation of the problem or verifying all its hypotheses\. Do not replace proof with “one checks,” “by symmetry,” “must snake,” or “no other arrangements occur\.”\#\# Algebra and polynomial checks\- Treat equality at two algebraic numbers as one linear constraint on polynomial coefficients\. Do not claim that a low\-degree polynomial taking equal values at two points must be constant\.\- To find a minimum degree, test degrees in increasing order\. WriteP⁡\(x\)=xd\+cd−1​xd−1\+⋯\+c0P\(x\)=x^\{d\}\+c\_\{d\-1\}x^\{d\-1\}\+\\cdots\+c\_\{0\}, expandP⁡\(α\)−P⁡\(β\)P\(\\alpha\)\-P\(\\beta\), and solve the resulting rational or radical coefficient equations\.\- Distinguish “both numbers are roots ofPP” from “PPhas equal values at both numbers\.” A minimal polynomial addresses the former and does not automatically solve the latter\.\- Verify monicity, integrality, nonconstancy, and minimality separately\. Substitute the proposed polynomial at both inputs before evaluating the requested expression\.\- For floors, signs, or infinite sums, pair terms only after handling endpoints and discontinuities exactly\.\#\# Counting and finite\-state checks\- Define exactly what one counted object is and whether order, labels, rotations, reflections, or orientations are distinct\.\- After identifying a structural skeleton, list every remaining independent choice\. Multiply binary choices, permutations, placements, and orientations only after proving independence\.\- Prove both directions of a classification: every valid object has the parameterization, and every parameter choice produces one valid object\.\- Before accepting a two\-case classification, attempt to construct a mixed or nested case\. A local gap condition need not force the same global order\.\- When counting rectangular dissections, enumerate both guillotine\-cut orientations and every side on which a spanning rectangle can occur\. Rotate the construction through all four sides, then check overlaps with strip cases\.\- For Hamiltonian grid paths, never infer the count from visible snakes\. Use a column/frontier recurrence or systematic case split that records visited cells, endpoint degrees, and component connectivity\. Reject premature cycles and disconnected leftovers\.\- For a manageable finite count, make a short recurrence/table rather than guessing\. Check a smaller width or modulus by hand\.\#\# Probability, expectation, and dynamics\- Use linearity of expectation with an indicator for each original item when possible; independence is unnecessary\.\- For simultaneous local updates, first prove the state afterttsteps in terms of the initial state\. On a cycle, check that the relevant window does not wrap or overlap unexpectedly\.\- Define the exact event that an initial value survives\. Condition on its rank or value and account for overlapping windows; do not silently treat them as independent\.\- A line determined by two uniform random points is not uniform in direction, offset, or edge pair\. Parameterize the two points directly, partition their product region, or integrate lines with the correct chord\-length\-squared weighting\.\- Use symmetry only after identifying the symmetry group and showing the compared events lie in the same orbit\. Confirm that the disjoint event probabilities sum to11\.\#\# Number theory and periodic events\- Translate periodic coincidences into gcd values within the stated common interval\. Use inclusion\-exclusion for moments with at least one, at least two, and all three events\.\- Write the symmetric gcd equations first; enforce divisibility and positivity while solving; substitute the candidate into every event count\.\- For counts over reduced residues, factor the modulus and apply inclusion\-exclusion to the actual constrained region\. For equations such asa\+b=ca\+b=c, count lattice pairs under the inequality and subtract divisibility conditions; do not assume uniform residues near a boundary\.\- State whether endpoints such as time00, the end of a period,00, or the modulus itself are included\.HMMT\-GPT\-5\-nano\-Skill\-5 \(continued\)\#\# Geometry checks\- Respect cyclic vertex order\. When placing a trapezoid or polygon, test the two possible orientations of the second base before declaring the figure degenerate or impossible\.\- Translate every side length from the labeled endpoints, not from visual left/right assumptions\. Reject a coordinate placement if it changes adjacency or vertex order\.\- For cyclic configurations, use the circle equation, powers, radical axes, or chord geometry\. Squared equations can introduce branches, so restore positivity and betweenness constraints afterward\.\- For prism cross\-sections, derive edge\-direction vectors as intersections of the cutting plane with each face\. Relate observed side lengths to box dimensions and the plane normal, solve the system, and only then use the normalized point\-to\-plane distance\.\- Check dimensions: a claimed identity between lengths must be invariant under scaling and must include any needed normalization factors\.\- Verify the final length against triangle inequalities, radius/chord bounds, and the scale of the diagram\.\#\# Mandatory final auditBefore boxing, answer internally:1\. What explicit equation, recurrence, bijection, or integral determines the value?2\. Did any step rely only on a picture, unsupported symmetry, or an unproved “standard” identity?3\. Were all rotations, orientations, branches, and independent choices included exactly once?4\. Does a small case, substitution, or alternate coordinate orientation confirm the result?5\. Is the final expression exact, fully evaluated, and the requested quantity?If any answer is unclear, repair that point before emitting the single boxed answer\.HMMT\-GPT\-5\-nano\-Skill\-6\# Solve Competition Math ProblemsFinish one exact contest solution\. Build the answer from the literal statement; do not continue a remembered solution to a superficially similar problem\.\#\# Enforce the output contract\- Reserve space for the decisive equations, verification, and final answer\.\- Never return an empty response or defer a finite computation\.\- If a derivation becomes long, compress prose and switch to a table, recurrence, coordinates, or inclusion\-exclusion\.\- End with exactly one ‘\\boxed\{…\}‘ containing only the requested value and nothing after it\.\- Use canonical exact notation inside the box: ‘\\frac‘, integers, powers, factorials, and simplified radicals\. Do not use ‘\\tfrac‘, prose, units, digit\-grouping commas, or unnecessary ‘\\left‘ and ‘\\right‘\.\#\# Follow the derive\-check\-finish loop1\. Restate internally the target and the data that define it\. Record order, labels, domains, strict inequalities, simultaneous actions, and acute/interior/betweenness conditions\.2\. Select a representation that makes every constraint algebraic: coordinates or vectors, indicators or integrals, residue classes, a bijection, or a finite state\.3\. Derive the governing equation, recurrence, or measure before substituting values\.4\. Resolve every branch introduced by symmetry, orientation, absolute values, or squaring using the original constraints\.5\. Verify by substitution, a small case, a second count, dimensional scaling, or a numerical approximation\.6\. Simplify completely and box the quantity requested\.Treat phrases such as “standard relation,” “one checks,” “by symmetry,” “the relevant root,” and “straightforward algebra” as proof gaps unless the omitted work is displayed or independently verified\.\#\# Complete combinatorial classifications\- Define the counted object and whether labels, order, rotations, reflections, and orientations distinguish it\.\- Prove both directions of a parameterization and prove uniqueness\. After finding a skeleton, list all remaining independent binary choices, permutations, placements, and orientations before multiplying\.\- For three copies of each symbol with equal counts in the two internal gaps, do not conclude that every pair alternates\. Encode a second symbol by its counts in the four gaps around a pivot and impose the condition in both directions\. Delete one extremal symbol to obtain a smaller valid word, then prove exactly which insertion modes restore it\. Use the resulting recurrence, including its insertion factor, rather than counting only repeated permutation blocks\.\- For a Hamiltonian path in a narrow grid, do not count visible “snake” patterns\. Use a row/column frontier state recording occupied vertices, degrees, endpoints, and component connectivity\. Reject premature cycles and sealed components\. Show a transfer table or recurrence totals and check a smaller grid\.\- For any manageable finite search, carry it out systematically\. A bare small integer is not evidence of exhaustive casework\.\#\# Use the correct measure in probability\- Express counts as sums of indicators whenever possible\. Dependence does not invalidate linearity of expectation\.\- A line through two independent uniform points is not uniform in direction, offset, or edge pair\. Parameterize the two points directly, or parameterize lines and weight each line by the square of its chord length\. Partition all possible boundary\-edge pairs, integrate the weighted regions, and verify that the disjoint probabilities sum to ‘1‘\.\- Use polygonal symmetry only after proving the events are in the same orbit under a symmetry preserving the sampling distribution\.\- For simultaneous local maximum updates, prove the radius\-‘t‘ window formula first; then characterize survival of an original value and handle cyclic overlap exactly\.HMMT\-GPT\-5\-nano\-Skill\-6 \(continued\)\#\# Make geometry branch\-safe\- Translate incidences into equations before calculating\. Preserve cyclic vertex order, parallelism, collinearity, betweenness, point\-interior conditions, and both reflected orientations\.\- Derive rather than invent a length identity\. Check homogeneity: a distance formula must scale as a length and a squared\-distance formula as a squared length\.\- For a rectangular\-prism plane section, let the normalized plane be ‘n dot x = h‘\. Obtain each section\-side direction from a cross product of ‘n‘ with the corresponding face normal\. Express all six signed side vectors in their cyclic order, impose vector closure, and solve for ‘h‘\. Do not use an unnormalized plane offset or assert a relation among opposite side squares\.\- For cyclic configurations, use powers, radical axes, chord formulas, or exact coordinates\. Translate a circle with diameter ‘AP‘ to ‘\(X\-A\) dot \(X\-P\)=0‘\. After solving squared equations, test every root against angle sign, interiority, and point order\.\- For circumradius data, use ‘R=a/\(2 sin A\)‘ in the actual labeled triangle\. Use acute hypotheses to choose positive projections and complementary\-angle branches\.\- For two circles and common external tangents, place the external homothety center at the origin and the tangent lines as a wedge\. Put circle centers on its angle bisector, express radii as distance times the wedge sine, and derive tangent lengths or areas from those coordinates\. Do not stop because the diagram is elaborate\.\- Check the result against triangle inequalities, chord bounds, positivity, and the scale of the figure\.\#\# Finish algebra and exact simplification\- For logarithmic exponent systems, introduce logarithms of the positive variables, convert every equation before multiplying or minimizing, and retain all sign branches allowed by positivity of the original variables\.\- For a symmetric algebraic system, display the equations obtained by subtracting pairs and justify every division by a nonzero difference\.\- After obtaining nested radicals, attempt canonical simplification\. To prove ‘sqrt\(U\-V sqrt\(d\)\) = a\-b sqrt\(d\)‘, match ‘a2\+b2​d=Ua^\{2\}\+b^\{2\}d=U‘ and ‘2ab=V‘, choose signs numerically, and square the final compact expression\.\- Do not leave a sum of large radicals merely because it is exact\. Numerically compare it with plausible ‘p\-q sqrt\(d\)‘ forms, derive the match algebraically, and box the simplified form\.\- Substitute proposed roots into the original unsquared equations and evaluate the requested expression only afterward\.\#\# Finish number theory and sequence computations\- For reduced residues with ‘a\+b=c<N‘, count lattice pairs in the triangular region first\. Apply inclusion\-exclusion for divisibility by each prime factor to that bounded region; residues are not uniformly distributed near ‘a\+b=N‘\. Cross\-check by summing valid pairs for each ‘c‘\.\- Translate periodic coincidences into gcd counts over the exact stated interval\. Use inclusion\-exclusion for “at least one,” “at least two,” and “all three,” enforce divisibility while solving for unknown periods, and check endpoints\.\- For named sequences, write their defining recurrence or digit rule with the stated indexing convention and tabulate through the requested index\. For digit\-defined sequences, enumerate the bounded interval in binary systematically\. For prime\-generating difference recurrences, compute each term from the gcd rule rather than recalling a value\.\- For floors, signs, and modular sums, isolate endpoints and discontinuities before pairing terms\.\#\# Mandatory auditBefore emitting the answer, verify internally:1\. Does a displayed equation, recurrence, bijection, table, or integral determine the value?2\. Were every orientation, insertion mode, branch, and independent choice included exactly once?3\. Did any unsupported symmetry or remembered “standard” formula carry the conclusion?4\. Was every bounded computation actually completed?5\. Was the result substituted back, scale\-checked or small\-case\-checked, and simplified?6\. Does the final box answer this problem rather than a nearby problem?Repair any failed item before producing the single boxed answer\.HMMT\-GPT\-5\-nano\-Skill\-7\# Solve Competition Math ProblemsProduce a finished solution to one problem\. Prefer explicit equations, recurrences, integrals, and bijections to plausible prose\.\#\# Honor the output contract\- Never refuse a finite computation, ask whether to continue, offer code instead of a result, or return an empty response\.\- Reserve the final 20 percent of the response budget for completing the calculation, checking it, and stating the answer\. If space becomes tight, compress exposition rather than abandon the derivation\.\- End with exactly one ‘\\boxed\{…\}‘ and nothing after it\.\- Put only the requested value in the box\. Use exact simplified notation\.\- Use ‘\\frac‘, not ‘\\tfrac‘\. Omit ‘\\,‘, ‘\\¡, ‘\\left‘, ‘\\right‘, ‘\\text‘, units, prose, and decorative spaces from the box\.\- Normalize equivalent forms to the problem’s natural canonical form, such as ‘3−1\\sqrt\{3\}\-1‘, ‘1−2π1\-\\frac\{2\}\{\\pi\}‘, or ‘9524\\sqrt\{\\frac\{95\}\{24\}\}‘\. Do not box a decimal when an exact value is requested\.\#\# Execute the reliability loop1\. Parse the literal target, labels, domains, order and betweenness conditions, strict inequalities, simultaneous actions, and whether objects are ordered or labeled\.HMMT\-GPT\-5\-nano\-Skill\-7 \(continued\)2\. Choose a concrete representation: equations, coordinates, indicators, residues, gap data, or a recurrence with a precisely defined state\.3\. Derive the governing relation before substituting numbers\.4\. Keep every sign, root, orientation, arc, and combinatorial branch until the original conditions reject it\.5\. Check one small case, transition, substitution, bound, or alternate orientation\.6\. Confirm that every displayed subtotal is reproducible, simplify exactly, and box\.Do not let “by symmetry,” “one checks,” “the pattern continues,” “there are two local choices,” or “the remaining computation is lengthy” carry a decisive step\.\#\# Complete finite counts\- Define exactly what one counted object is and whether rotations, reflections, labels, orders, or construction histories distinguish it\.\- Prove both directions of a classification: every valid object has the stated parameters, and each parameter choice yields exactly one valid object\.\- Treat a symmetric family as a lower bound until all mixed, nested, and interleaved configurations are excluded\.\- List every independent order, side, placement, orientation, and binary choice before multiplying\. Test the classification with one, two, or three labels\.\- For three copies of every symbol with equal\-between\-occurrences conditions, encode all symbols by their counts in the four gaps and apply the condition with each symbol as pivot\. Expect recursively nested choices; do not assume only consecutive triples or three identical blocks\.\#\#\# Paths and grids\- For a small self\-avoiding walk, use the exact stateF⁡\(v,S\)=∑w∼vw∉SF⁡\(w,S∪\{w\}\),F\(v,S\)=\\sum\_\{\\begin\{subarray\}\{c\}w\\sim v\\\\ w\\notin S\\end\{subarray\}\}F\(w,S\\cup\\\{w\\\}\),with a base case that enforces the prompt’s stopping and coverage conditions\. Display a symmetry reduction, state table, or subtotals sufficient to audit the result\.\- For a long narrow Hamiltonian path, scan by columns and record frontier occupancy, vertex degrees, connectivity pairings, and endpoint status\. Reject degree violations, premature cycles, sealed components, and early connection of the endpoints\.\- Never multiply “two snake patterns per block” unless boundary states prove that all patterns are compatible and independent\. Check the smallest two widths first\.\- For a path avoiding one uniformly random blocked cell, use indicators or count path\-cell incidences\. Include the possibility that an endpoint is blocked exactly as stated\.\#\#\# Rectangle dissections\- Classify a three\-rectangle dissection by either two parallel full cuts or one full cut followed by one perpendicular cut in either resulting piece\.\- For each full\-cut direction, count both sides that can receive the second cut\. Include vertical and horizontal rotations\.\- Check overlap only between construction classes that can describe the same final dissection; do not discard a valid side choice merely because it is a reflection\.\#\# Use the actual probability measure\- Begin with the random experiment in the statement\. Uniform random points do not induce a uniform line direction, offset, chord, or edge pair\.\- For two points in a convex polygon, parameterize the point pair directly or integrate over lines with the correct point\-pair weight\. Partition favorable and unfavorable regions into disjoint cases and verify that their measures sum to the total\.\- Use symmetry only after naming the symmetry action and proving the compared events are in the same orbit under the sampling distribution\.\- Never emit a bare probability; display the favorable and total measure or an equivalent exact integral\.\#\# Handle expectations and simultaneous dynamics\- Write a requested random count as a sum of indicators\. Independence of the indicators is unnecessary\.\- For simultaneous radius\-one maximum updates, first prove that the time\-ttvalue is the maximum of the original cyclic window of radiustt\.\- Count distinct surviving initial labels, not distinct windows or positions\. Overlapping window maxima are usually repeated\.\- Characterize survival using the distances to the nearest larger initial value on each side, or condition on the value/rank and integrate\. A label survives exactly when at least one permitted window containing it excludes all larger labels\.\- Check the formula att=0t=0,t=1t=1, and when the window approaches the cycle length\. Never assert that maxima of overlapping windows are almost surely distinct\.\#\# Preserve exact algebra\- For floors, pair positive and negative indices only after resolving endpoints and signs exactly\.\- For interpolation, logarithms, and symmetric systems, transform the full equations before evaluating\. Substitute every proposed solution into the original conditions\.\- When a sign sequence such as ‘s​g​n​\(s​i​n​\(2n\)\)sgn\(sin\(2^\{n\}\)\)‘ appears, seek a digit identity before sampling numerically\. In particular, relate the sign to the parity of ‘⌊2n/π⌋\\lfloor 2^\{n\}/\\pi\\rfloor‘, identify that parity with a binary digit of ‘1/π1/\\pi‘, and sum the binary expansion exactly\.\- Do not infer an infinite sign pattern from a finite numerical prefix\. A tail bound certifies an approximation, not an exact contest answer\.\- For equality of polynomial values at algebraic inputs, expand the difference directly; do not confuse equal values with both inputs being roots\.\#\# Count arithmetic objects exactly\- Translate percentages and “strictly more than” conditions into integer inequalities before optimizing\.\- For reduced residues subject to ‘a\+b=c‘, preserve the ordered nature and the bound ‘a\+b<N‘\. Count by residue classes with truncated quotient ranges or use a complete inclusion\-exclusion table; audit all intersections and boundaries\.\- For periodic coincidences, translate event counts to gcd values in the stated interval and use inclusion\-exclusion\. State whether time zero and period endpoints are included\.\- Cross\-check a modular pair count by summing over ‘c‘ or by a second equivalent formula\.\#\# Make geometry branch\-safe\- Set coordinates from incidences, cyclic order, and betweenness rather than from the apparent diagram\. Translate perpendicularity to dot products, concyclicity to a circle equation or powers, and tangency to distance from a center\.HMMT\-GPT\-5\-nano\-Skill\-7 \(continued\)\- Enumerate reflections and signed placements\. For parallel chords or an isosceles trapezoid, test whether the chords lie on the same or opposite sides of the center and both endpoint correspondences\.\- After squaring, restore the original unsquared equation, positivity, acuteness, interior, and point\-order constraints\. If a squared length becomes negative or implausible, revisit the branch rather than declaring the problem impossible\.\- For a circle with diameter ‘AB‘, use ‘\(X−A\)⋅\(X−B\)=0\(X\-A\)\\cdot\(X\-B\)=0‘\. For a circumradius, use ‘R=abc/\(4K\)‘ or the sine rule and use acuteness to choose signs\.\- Check the final result against scale, triangle inequalities, chord bounds, and all original incidences\.\#\#\# Prism sections\- Represent the cutting plane as ‘n⋅x=dn\\cdot x=d‘\. Derive the three section\-edge directions as intersections with coordinate faces\.\- Use the six side lengths in cyclic order, vector closure, and translations between opposite faces to recover the box dimensions and plane offset\. Opposite section sides are parallel but need not have equal lengths\.\- Compute the requested distance as ‘\|d−n⋅c\|/‖n‖\|d\-n\\cdot c\|/\\\|n\\\|‘, where ‘c‘ is the prism center\. Do not average side lengths or invoke an unproved section identity\.\#\# Pre\-box auditConfirm internally:1\. Does an explicit equation, recurrence, integral, or bijection determine the value?2\. Did the solution count objects rather than construction stories, windows, or local patterns?3\. Are all orientations, roots, overlaps, independent choices, and boundary cases included exactly once?4\. Does a substitution, small case, scale check, or total\-measure check agree?5\. Is the response complete, exact, canonical, and terminated by one undecorated box?Repair any failed item before emitting the answer\.HMMT\-GPT\-5\-nano\-Skill\-8\# Solve Competition Math ProblemsSolve only the problem in the current prompt\. Treat remembered solutions, earlier questions, and visually similar problems as untrusted\.\#\# Lock the target before solvingWrite a private one\-line fingerprint:‘objects \| distinctive constants \| constraints \| requested quantity‘Use it as a hard invariant:\- Make the first equation involve the current objects or constants\.\- Stop and restart if the draft introduces central objects, dimensions, or numbers absent from the fingerprint\.\- Re\-read the final sentence before boxing\. Confirm that the computed quantity has the requested meaning and scale\.\- Never reuse a derivation or answer merely because another contest problem looks familiar\.This check takes priority over continuing an attractive solution\.\#\# Preserve a valid answer\- Produce a nonempty response with a compact derivation\.\- End with exactly one final line of the form ‘\\boxed\{VALUE\}‘ and put no text after it\.\- Include the backslash in ‘\\boxed‘; never write ‘boxed\{VALUE\}‘\.\- Put only the exact requested value inside the box\. Use ‘\\frac‘, simplified radicals, integers, powers, and standard constants\.\- Omit prose, units, ‘\\text‘, ‘\\,‘, ‘\\¡, ‘\\left‘, ‘\\right‘, and decorative spaces from the box\.\- If time or output becomes tight, discard exposition, retain the determining equations and one check, then box the result\.\#\# Execute the solve–audit loop1\. Parse labels, domains, strict inequalities, endpoint conventions, simultaneity, order, and the target\.2\. Choose a concrete representation: equations, coordinates, indicators, residues, inclusion\-exclusion, or a defined recurrence\.3\. Display the relation that determines the answer before giving a numerical subtotal\.4\. Keep all cases until an original condition rejects them\.5\. Check one small instance, endpoint, substitution, independent derivation, or scale bound\.6\. Compare the work to the target fingerprint, simplify, and box\.Never replace the decisive step with “standard,” “routine elimination,” “careful enumeration,” “by symmetry,” “one obtains,” or “must snake\.”\#\# Audit arithmetic and finite sets\- Write the size of every index set before pairing or partitioning it\. Under a fixed\-point\-free involution, the number of pairs is half the number of elements, not half the apparent span\.HMMT\-GPT\-5\-nano\-Skill\-8 \(continued\)\- List unpaired endpoints and fixed points explicitly\. For floors, use⌊x⌋\+⌊−x⌋=\{0,x∈ℤ,−1,x∉ℤ\.\\lfloor x\\rfloor\+\\lfloor\-x\\rfloor=\\begin\{cases\}0,&x\\in\\mathbb\{Z\},\\\\ \-1,&x\\notin\\mathbb\{Z\}\.\\end\{cases\}Count divisibility exceptions only after determining the exact denominator range\.\- Preserve dimensions and scaling\. Reject an identity equating a length with a squared length or one that changes under uniform scaling\.\- Recompute the final arithmetic from the displayed subtotals\. A correct method with one wrong table entry is still wrong\.\#\# Make finite enumeration reproducible\- Define a state and base case\. For a bounded self\-avoiding walk, useF⁡\(v,S\)=∑w​legal from​vw∉SF⁡\(w,S∪\{w\}\),F\(v,S\)=\\sum\_\{\\begin\{subarray\}\{c\}w\\text\{ legal from \}v\\\\ w\\notin S\\end\{subarray\}\}F\(w,S\\cup\\\{w\\\}\),with the target base case chosen to match whether every cell must be visited\.\- For long narrow Hamiltonian paths, use frontier states recording vertex degrees and component connectivity\. Reject premature cycles, sealed components, and unreachable leftover cells\.\- Show a case table, recurrence values, or transfer totals sufficient to reproduce the count\. Do not claim to have run DFS without showing its result structure\.\- Treat a visible snake or a two\-pattern picture as a lower bound until mixed patterns are excluded\.\- For arrangements, prove both directions of the parameterization and list every independent permutation, placement, orientation, and binary choice before multiplying\.\#\# Handle probability and simultaneous dynamics\- Express an expected count as a sum of indicators\. Independence of the indicators is unnecessary\.\- Prove the state afterttsimultaneous updates by induction before analyzing it\. Check cycle wraparound against the actual cycle length\.\- For sliding\-window maxima, characterize exactly when one original value appears as at least one window maximum\. Use nearest\-greater gaps or condition on its value/rank; do not assume all windows avoiding the global maximum have distinct maxima\.\- Verify any general expectation formula on a tiny cycle by listing the windows\.\- For a line through two uniform points, do not treat line direction, offset, or edge\-pair type as uniform\. Parameterize the two points directly, or weight each line by the square of its chord length\. Partition all edge\-pair cases and confirm their probabilities sum to11\.\- Never emit a bare probability without favorable and total measures\.\#\# Count residues and periodic events exactly\- For reduced residues satisfyinga\+b=c<ma\+b=c<m, count the triangular inequality region together with divisibility exclusions\. Near the boundary, residue classes are truncated and are not uniformly populated\.\- Cross\-check ordered\-pair counts by summing overccand by inclusion\-exclusion overaa, or verify every residue subtotal explicitly\.\- For periodic coincidences, translate event intersections into gcd values over the stated time interval\. Apply inclusion\-exclusion and state whether time00or the period endpoint is included\.\- For divisors, parameterize prime exponents, impose the terminal\-digit congruence, and enumerate the small residue cycles explicitly\.\- For named sequences, state the definition and indexing convention, compute a short table from it, and verify a known initial term\. Do not silently mix zero\-based and one\-based conventions or substitute a different sequence problem\.\#\# Keep geometry branch\-safe\- Encode incidences and signed orientation in coordinates: vertex order, betweenness, inside, acute, and which side of a line contains a point\.\- Carry both circle, chord, tangent, trapezoid, and square\-orientation branches until the original constraints select one\.\- After squaring, substitute every candidate into the unsquared relation and all interior or acute conditions\.\- Use the labeled endpoints rather than the apparent diagram orientation\. Check triangle inequalities, chord bounds, circumradius bounds, and approximate scale\.\- For a prism plane section, derive the three section\-edge direction vectors from the plane normal\. Use vector closure and all six side lengths before computing the normalized center\-to\-plane distance\. Do not invent identities from sums of opposite side lengths\.\- For circumradius data, useR=a​b​c/\(4​K\)R=abc/\(4K\)ora=2​R​sin⁡Aa=2R\\sin A, retaining the sign information supplied by acute\-angle hypotheses\.\#\# Final gateDo not box until all answers are yes:1\. Does the fingerprint still match the problem being solved?2\. Is there a displayed equation, recurrence, integral, or complete case count determining the value?3\. Are endpoints, branches, duplicates, and independent choices accounted for?4\. Has one local or global check passed?5\. Is the last line exactly one canonical ‘\\boxed\{VALUE\}‘?HMMT\-GPT\-5\-nano\-Skill\-9\# Solve Competition Math ProblemsSolve the problem independently\. Use the instructions below as method guidance, not as permission to reuse an answer from an evaluation artifact\.\#\# Guarantee a usable answer\- Determine the requested quantity before polishing exposition\.\- Keep the solution compact\. Prefer decisive equations, a recurrence, or a finite table to a long exploratory narrative\.\- Abandon an approach that is not producing a governing equation\. Switch representations and finish\.\- Never return an empty response, ‘…‘, a request for corrected data, or an unevaluated setup\.\- Trust that a contest statement is intentional unless a contradiction follows from proved equations\. Do not reject an unfamiliar configuration merely because it violates a guessed property\.\- End with exactly one parser\-safe ‘\\boxed\{…\}‘ containing only the simplified value\.\- Inside the box, use ordinary LaTeX only\. Do not use ‘\\,‘, ‘\\¡, ‘\\left‘, ‘\\right‘, prose, units, or surrounding punctuation\. Prefer exact fractions and radicals to decimals\.\#\# Solve in five passes1\. \*\*Parse\.\*\* Write the target and every literal constraint, including order, betweenness, simultaneity, endpoints, labels, and whether choices are ordered\.2\. \*\*Model\.\*\* Choose concrete variables and one auditable representation: equations, indicators, coordinates, residues, inclusion\-exclusion, or a recurrence with a defined state\.3\. \*\*Derive\.\*\* Obtain the formula determining the target before doing lengthy arithmetic\. Do not replace this with visual intuition or “by symmetry\.”4\. \*\*Filter\.\*\* Enforce positivity, bounds, orientation, integrality, distinctness, and branch conditions after solving\.5\. \*\*Verify\.\*\* Substitute the candidate or test a small case, then simplify and box the quantity actually requested\.\#\# Completion discipline\- Reserve the final portion of the response for evaluation and the box\.\- If a proof threatens to become long, state only the definitions, decisive relation, computation, and one check\.\- For a finite computation, build a small exact table or recurrence rather than narrating hypothetical cases\.\- If several branches remain, evaluate them systematically and use the original constraints to select one\. Do not stop at the branch equations\.\#\# Probability and simultaneous dynamics\- Parameterize the original random objects\. A line through two uniform points is not uniform in direction, offset, chord, or edge pair\.\- If integrating over lines, include the pair\-to\-line Jacobian: integrating two ordered points along a chord of lengthℓ\\ellgives weight proportional toℓ3\\ell^\{3\}, not equal weight for each line\. Direct integration over the two points is often safer\.\- Use symmetry only after showing the events are in the same orbit under a symmetry preserving the probability measure\. Partition the entire sample space into disjoint cases and check that their probabilities sum to11\.\- For an expectation, define indicators whose sum is exactly the target; independence is unnecessary\.\- For simultaneous radius\-one maximum updates, prove that afterttsteps each entry is the maximum of its original length\-2​t\+12t\+1window\.\- To count distinct maxima of cyclic sliding windows, count changes between consecutive windows rather than attempting a complicated survival\-by\-rank formula\. For continuous iid values and window lengthL<nL<n, a transition changes precisely when the leaving or entering item is the maximum of theL\+1L\+1items in the union, an event of probability2/\(L\+1\)2/\(L\+1\)\. Check separately that the cyclic sequence is not constant\.\#\# Counting and number theory\- Define one counted object and whether order, labels, rotations, and reflections distinguish it\.\- Prove both directions of a classification: every valid object has the proposed parameters, and every allowed parameter choice creates one valid object\.\- Never infer a global count from a few visible “snake” patterns\. For Hamiltonian grid paths, use a row/column frontier DP or exhaustive recurrence whose state records used boundary vertices, degrees, endpoints, and component connectivity\. Reject premature cycles and disconnected leftovers\. Validate on a smaller width\.\- For constrained triples such asa\+b=ca\+b=c, first count the lattice region imposed by positivity and the inequality, then use inclusion\-exclusion for divisibility restrictions\. Boundaries destroy naive uniform\-residue arguments\.\- For periodic coincidences in a common interval, pairwise and triple intersections are gcds\. Write inclusion\-exclusion equations for “at least one” and “at least two,” solve the integer constraints, and substitute back\.\- For divisor percentages, pair each divisorddwithn/dn/d, translate strict percentage inequalities exactly, and search factorizations through the divisor\-count formula\. Check strictness at the cutoff\.\- For a named integer sequence whose definition is omitted, state the canonical initial values and recurrence being used, check the indexing convention against its first terms, and compute forward in a table\. Never guess a distant term from a pattern\.\#\# Algebra\- Convert logarithmic exponent equations by setting variables such asX=log2⁡xX=\\log\_\{2\}x; equate prime\-exponent components and preserve all sign branches before minimizing\.\- For symmetric systems in several roots, compare the polynomial satisfied by each variable with the monic polynomial having those roots\. Verify distinctness and nonzero assumptions afterward\.\- For floors, signs, and infinite sums, handle endpoints and discontinuities before pairing terms\.\- Keep radicals and rational arithmetic exact\. After squaring, restore sign and domain constraints\.HMMT\-GPT\-5\-nano\-Skill\-9 \(continued\)\#\# Geometry\- Introduce coordinates, vectors, powers, or exact trigonometry\. Do not measure or trust the drawing\.\- Respect labeled cyclic order and betweenness\. For a trapezoid with unequal bases, test both horizontal offsets compatible with the leg lengths; an apparently valid coordinate placement may encode the wrong orientation\.\- A common chord is a radical axis\. “The common chord bisects a segment” means the segment midpoint has equal powers to the two circles; it does not identify the midpoint with a circle center\.\- For circle configurations, use circle equations, power of a point, radical axes, chord\-distance formulas, or homothety\. Check which tangent, arc, and intersection the statement selects\.\- A plane section of a rectangular prism is not generally centrally symmetric unless the plane passes through the prism center\. Opposite section edges may be parallel without being equal\.\- For a prism section, write the plane asu​x\+v​y\+w​z=hux\+vy\+wz=h, derive each section edge as an intersection with a face, relate its length to the box dimensions and\(u,v,w,h\)\(u,v,w,h\), and compute the center\-to\-plane distance as\|h\|/u2\+v2\+w2\|h\|/\\sqrt\{u^\{2\}\+v^\{2\}\+w^\{2\}\}\. Do not invent equal\-opposite\-side constraints or declare a typo\.\- After solving, check segment membership, triangle inequalities, chord bounds, scale, and all alternate orientations\.\#\# Pre\-box auditBefore emitting the answer, confirm:1\. An explicit equation, recurrence, count, or integral determines the value\.2\. No probability used an unproved uniformity assumption\.3\. No finite count came only from a picture or a few patterns\.4\. All orientations, signs, and extraneous roots were checked\.5\. The result was substituted into the original constraints or tested on a small case\.6\. The final box is nonempty, exact, fully evaluated, and free of spacing macros\.HMMT\-GPT\-5\-nano\-Skill\-10\# Solve Competition Math ProblemsSolve one problem completely from its literal statement\. Prefer a concrete equation, recurrence, integral, coordinate model, or bijection to a plausible shortcut\.\#\# Protect completion and answer parsing\- Reserve the final 20 percent of the response budget for calculation, verification, and the answer\.\- Never return an empty response, apologize, ask to continue, or stop at a plan\. If an approach stalls, switch representations and give the shortest decisive derivation available\.\- End with exactly one ‘\\boxed\{…\}‘ and nothing after it\.\- Put only the requested value in the box\. Use exact simplified notation\.\- Use ‘\\frac‘, not ‘\\tfrac‘\. Remove ‘\\,‘, ‘\\¡, ‘\\left‘, ‘\\right‘, ‘\\text‘, units, prose, and decorative spaces from the box\.\- Canonicalize equivalent forms, for example ‘3−1\\sqrt\{3\}\-1‘, and ‘1−2π1\-\\frac\{2\}\{\\pi\}‘\.\#\# Run the solve–audit loop1\. Parse the target, domains, labels, cyclic order, simultaneity, strict inequalities, and all order or betweenness conditions\.2\. Choose a representation that makes validity checkable\.3\. Derive the governing relation before inserting numbers\.4\. Retain every sign, root, orientation, overlap, and combinatorial branch until an original condition rejects it\.5\. Verify with a small case, substitution, independent count, total\-measure check, or scale bound\.6\. Simplify the quantity actually requested and box it\.Treat “by symmetry,” “standard identity,” “there are two patterns,” “the choices are independent,” and “this bound is attainable” as claims requiring proof\.\#\# Prevent boundary and algebra errors\#\#\# Floors and paired sums\- Write the involution on indices explicitly and list its orbits at both endpoints before summing\.\- For a denominator ‘j\+1/2‘, pairing ‘j‘ with ‘\-j\-1‘ creates exact opposite denominators\. Apply the map to the full stated interval; do not invent an unpaired endpoint\.\- Use⌊x⌋\+⌊−x⌋=\{0,x∈ℤ,−1,x∉ℤ\.\\lfloor x\\rfloor\+\\lfloor\-x\\rfloor=\\begin\{cases\}0,&x\\in\\mathbb\{Z\},\\\\ \-1,&x\\notin\\mathbb\{Z\}\.\\end\{cases\}Count exceptional integer pairs by an exact divisibility condition and audit the smallest and largest denominator\.\#\#\# Exact transformations\- Preserve strict versus weak inequalities through integer rounding\.\- After squaring, clearing denominators, or taking residues, substitute candidates into the original equation\.HMMT\-GPT\-5\-nano\-Skill\-10 \(continued\)\- For an infinite sign series such as ‘s​g​n​\(s​i​n​\(2n\)\)sgn\(sin\(2^\{n\}\)\)‘, seek a digit or floor identity\. Do not infer an infinite pattern from numerical samples\.\#\# Make finite counts exhaustive\- Define one counted object and whether labels, orders, rotations, reflections, or construction histories distinguish it\.\- Prove both directions of a classification: every valid object enters one case, and every parameter choice creates exactly one valid object\.\- List residual orders, sides, orientations, and placements before multiplying\.\- Use a necessary parity, coloring, or symmetry condition only as a filter, never as a complete count\.\#\#\# Hamiltonian grid paths\- Never decompose a long grid into independent blocks without proving all boundary states and compatibility conditions\.\- Scan a narrow grid by columns\. Record frontier occupancy, degrees, connectivity pairings, and which specified endpoints have appeared\.\- Reject degree above two, premature cycles, sealed components, and reaching the destination before all cells are used\.\- For a small board, useF⁡\(v,S\)=∑w∼vw∉SF⁡\(w,S∪\{w\}\),F\(v,S\)=\\sum\_\{\\begin\{subarray\}\{c\}w\\sim v\\\\ w\\notin S\\end\{subarray\}\}F\(w,S\\cup\\\{w\\\}\),with a base case that accepts the target only after every required cell is visited\.\- Show a transition table, recurrence values, or auditable subtotals; do not merely report that enumeration gives the result\.\#\#\# Divisors and periodic coincidences\- Factor the fixed divisor first, then parameterize additional prime exponents without double\-counting primes already present\.\- Translate a percentage condition to an integer inequality before optimizing\.\- If writing each divisor as ‘d0​sd\_\{0\}s‘, prove the representation is unique, usually by requiring coprime factors\.\- Distinguish an upper bound for a favorable count from an achievable count\. For attainability, construct an explicit exponent pattern and recount all threshold cases exactly\.\- Use complementary divisor pairs ‘d‘ and ‘n/d‘ to audit threshold counts\.\- For periodic events, count moments with gcd/lcm and inclusion–exclusion\. State whether time zero and the period endpoint represent the same moment, then solve the resulting integer system and verify it\.\#\# Use the real probability measure\- Start from the random experiment in the statement\. Two uniform points in a polygon do not induce a uniform line direction, offset, chord, or edge pair\.\- Parameterize the two points directly, or integrate over lines with the correct point\-pair weight, proportional to the square of the chord length\.\- Partition favorable and unfavorable configurations into disjoint measurable cases\.\- Use symmetry only after naming a measure\-preserving symmetry that maps one event to the other\.\- Display the favorable measure and total measure, or an equivalent exact integral\. Never emit a bare guessed probability\.\#\# Handle expectations and simultaneous dynamics\- Express a random count as a sum of indicators; independence is unnecessary\.\- For simultaneous radius\-one maximum updates, prove by induction that after ‘t‘ steps each position contains the maximum of its original cyclic radius\-‘t‘ window\.\- Count distinct surviving original labels, not positions or windows\. With continuous samples, values are almost surely distinct initially but overlapping window maxima repeat\.\- Characterize survival using the nearest larger original value on each side\. A label survives exactly when some length\-‘2t\+1‘ cyclic window containing it excludes every larger label\.\- Evaluate the survival probability by ranks or gap lengths, then sum indicators\.\- Check ‘t=0‘, ‘t=1‘, and the regime where a window approaches the whole cycle\.\#\# Make geometry branch\-safe\- Assign coordinates from incidences, cyclic order, and betweenness, not from the apparent diagram\.\- Translate perpendicularity to dot products, concyclicity to a circle equation or powers, and tangency to center\-line distance\.\- Enumerate reflected and signed placements\. Restore positivity, interior, acuteness, and point\-order conditions after algebraic elimination\.\- Verify every supplied length or angle in the final configuration, not merely the equation used to find it\.\- Check scale, triangle inequalities, chord bounds, and radical positivity\.\#\#\# Rectangular\-prism sections\- Represent the plane as ‘n⋅x=dn\\cdot x=d‘ and the prism with explicit coordinate bounds\.\- Derive section\-edge directions by intersecting the plane with each coordinate face\.\- Use all six side lengths in cyclic order, vector closure, and translations between opposite faces to determine the compatible box and plane parameters\.\- Compute the center\-to\-plane distance as ‘\|d−n⋅c\|/‖n‖\|d\-n\\cdot c\|/\\\|n\\\|‘\.\- Do not assume alternating square sums determine the distance, average side lengths, or cite an unproved “standard identity\.” Reconstruct all six edges and check the scale before accepting the result\.\#\#\# Circle, tangent, and angle configurations\- Use radical axes and homothety for two\-circle common\-tangent configurations; retain both internal/external placement branches until tangency and intersection conditions select one\.\- For a circumcenter constrained to a line, solve perpendicular\-bisector equations and test the nondegenerate root against segment conditions\.\- For angle\-sum conditions, use signed dot/cross products or tangent formulas so supplementary\-angle branches are not silently accepted\.\- For a concave quadrilateral, establish vertex order and compute its area as a signed polygon area or as the correct sum/difference of triangle areas\.HMMT\-GPT\-5\-nano\-Skill\-10 \(continued\)\#\# Final auditBefore answering, confirm:1\. An explicit equation, recurrence, integral, or exhaustive classification determines the value\.2\. Every endpoint, strict inequality, orientation, root, and overlap was handled\.3\. No count relies on unproved independence or unattained bounds\.4\. A substitution, small case, alternate computation, total measure, or scale check agrees\.5\. The response is complete and ends in one canonical undecorated box\.Repair any failed item before emitting the answer\.Sudoku\-GPT\-5\-nano\-Skill\-1\# Solve SudokuSolve a standard 9x9 Sudoku exactly\. Treat each given digit as immutable and each ‘X‘ as an empty cell\.\#\# Output contractReturn exactly one of the following forms\.For a completed puzzle:<answer\>‘‘‘python\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)‘‘‘</answer\>If the puzzle cannot be completed within the available budget:<answer\>TIMEOUT</answer\>Apply these formatting requirements strictly:\- Emit no text before or after the ‘<answer\>‘ element\.\- For a solution, place only one ‘python‘ code block inside ‘<answer\>‘\.\- Use one outer tuple containing exactly nine inner tuples\.\- Put exactly nine integer digits from 1 through 9 in each inner tuple\.\- Do not emit ‘X‘, zero, lists, strings, explanations, or verification notes\.\- Never present a partial or unverified grid as a solution\.\#\# Solve1\. Parse exactly nine rows of nine cells\. Reject any interpretation that changes a given digit\.2\. Check the givens for duplicate digits in any row, column, or 3x3 box\.3\. For every empty cell, compute:‘candidates = \{1, …, 9\} \- row\_digits \- column\_digits \- box\_digits‘4\. Propagate constraints until reaching a fixed point:\- Fill naked singles: cells with exactly one candidate\.\- Fill hidden singles: digits that occur in only one candidate set within a row, column, or box\.\- After every fill, update all affected peers immediately\.\- Treat an empty candidate set or a duplicate fixed digit as a contradiction\.5\. If propagation stalls, use depth\-first backtracking:\- Choose an empty cell with the fewest candidates\.\- Break ties in row\-major order\.\- Try candidate digits in ascending order\.\- Propagate constraints after each tentative assignment\.\- Undo the assignment immediately upon contradiction\.6\. Continue until a complete solution is found or all branches fail\. Prefer a complete verified solution whenever the budget permits; use ‘TIMEOUT‘ only when execution genuinely cannot finish\.Sudoku\-GPT\-5\-nano\-Skill\-1 \(continued\)\#\# Verify before answeringDo not emit a grid until every check passes:\- The grid has exactly 9 rows and 9 columns\.\- Every value is an integer from 1 through 9\.\- Every original clue remains unchanged\.\- Every row equals the set ‘1, …, 9‘\.\- Every column equals the set ‘1, …, 9‘\.\- Every 3x3 box equals the set ‘1, …, 9‘\.If any check fails, resume solving or return ‘<answer\>TIMEOUT</answer\>‘; never guess the final grid\.Sudoku\-GPT\-5\-nano\-Skill\-2\# Solve SudokuSolve each puzzle in three distinct phases: parse, solve, and format\. Keep search traces and internal reasoning private\.\#\# Parse the Puzzle1\. Extract exactly 81 cells and reshape them into nine rows of nine cells\.2\. Interpret ‘X‘ as an empty cell and digits ‘1‘ through ‘9‘ as fixed clues\.3\. Reject malformed input that does not describe a 9x9 grid\.4\. Record every clue so the completed grid can be checked against the original puzzle\.5\. Before solving, reject any grid whose clues already duplicate a digit within a row, column, or 3x3 box\.\#\# Track ConstraintsMaintain these sets:\- ‘row\_used\[r\]‘: digits already assigned in row ‘r‘\- ‘col\_used\[c\]‘: digits already assigned in column ‘c‘\- ‘box\_used\[b\]‘: digits already assigned in box ‘b‘, where ‘b = 3 \* \(r // 3\) \+ \(c // 3\)‘For an empty cell ‘\(r, c\)‘, compute:‘‘‘text1, …, 9 \- row\_used\[r\] \- col\_used\[c\] \- box\_used\[b\]‘‘‘Recompute affected candidates after every assignment\. Treat an empty candidate set as an immediate contradiction\.\#\# SolveApply deterministic constraint propagation until no further placement is available:1\. Place naked singles\.2\. Place hidden singles in rows, then columns, then boxes\.3\. Apply safe box\-line interactions when they eliminate candidates\.4\. After every placement, update all three constraint sets and propagate again\.When propagation stalls, use depth\-first search:1\. Select an empty cell with the fewest candidates \(MRV\)\.2\. Break MRV ties in row\-major order\.3\. Try candidate digits in ascending order\.4\. Propagate constraints after each trial assignment\.5\. Backtrack immediately on a duplicate, an empty candidate set, or a unit that can no longer place a missing digit\.Keep the decision trail private\. Do not expose guesses, backtracking traces, chain\-of\-thought, or intermediate grids unless the user explicitly requests a concise explanation\.\#\# ValidateBefore returning a solution, verify all of the following:\- The grid contains exactly nine rows of nine integer digits\.\- Every original clue remains unchanged\.\- Every row contains digits ‘1‘ through ‘9‘ exactly once\.\- Every column contains digits ‘1‘ through ‘9‘ exactly once\.\- Every 3x3 box contains digits ‘1‘ through ‘9‘ exactly once\.\- No ‘X‘ or other placeholder remains\.Never return an unvalidated grid\. If exhaustive deterministic search proves that no solution exists, report:Sudoku\-GPT\-5\-nano\-Skill\-2 \(continued\)‘‘‘textSudoku has no valid solution\.‘‘‘If solving cannot finish within the allowed time, report exactly:‘‘‘textSudoku solver timed out; unable to produce a solution within the allowed time\.‘‘‘\#\# Format the AnswerFor a successful solution, return only an ‘<answer\>‘ element containing one Python code block\. The code block must contain a 9\-tuple of 9\-tuples in row\-major order:‘‘‘‘text<answer\>‘‘‘python\(\(1, 2, 3, 4, 5, 6, 7, 8, 9\),\(4, 5, 6, 7, 8, 9, 1, 2, 3\),…\)‘‘‘</answer\>‘‘‘‘Use integers, not strings\. Use tuples, not lists\. Do not include commentary outside the ‘<answer\>‘ element\.Sudoku\-GPT\-5\-nano\-Skill\-3\# Solve SudokuSolve the puzzle completely using constraint propagation followed by exact backtracking when needed\. Keep all reasoning, candidate lists, and search traces private\.\#\# Parse and Validate the Puzzle1\. Extract exactly nine rows of nine cells\.2\. Interpret ‘X‘ or ‘0‘ as an empty cell and digits ‘1‘ through ‘9‘ as immutable givens\.3\. Record the givens separately so they can be verified after solving\.4\. Reject malformed input or givens that already repeat a digit within a row, column, or 3x3 box\.Use zero\-based row and column indices\. Compute the box containing ‘\(r, c\)‘ as:‘‘‘textbox\(r, c\) = 3 \* \(r // 3\) \+ \(c // 3\)‘‘‘\#\# Maintain ConstraintsTrack:\- ‘row\_used\[r\]‘: digits placed in row ‘r‘\- ‘col\_used\[c\]‘: digits placed in column ‘c‘\- ‘box\_used\[b\]‘: digits placed in box ‘b‘For each empty cell ‘\(r, c\)‘, compute its candidates exactly as:‘‘‘text1, 2, 3, 4, 5, 6, 7, 8, 9\- row\_used\[r\]\- col\_used\[c\]\- box\_used\[box\(r, c\)\]‘‘‘Treat any empty cell with no candidates as a contradiction\. Also treat a duplicate fixed digit in any row, column, or box as a contradiction\.\#\# Propagate Forced PlacementsRepeat until a full pass makes no progress:1\. \*\*Naked singles:\*\* Fill every empty cell with exactly one candidate\.2\. \*\*Hidden singles:\*\* For each row, column, and box, place any missing digit that can occur in only one empty cell in that unit\.3\. Update the grid and all three constraint structures after every placement\.4\. Recompute affected candidates and stop the current branch immediately if a contradiction appears\.An incomplete grid with multiple candidates is a stalled propagation state, not a failure\. Continue with search\.\#\# Search ExactlyWhen propagation stalls:Sudoku\-GPT\-5\-nano\-Skill\-3 \(continued\)1\. Choose an empty cell with the fewest candidates\.2\. Break ties in row\-major order\.3\. Try candidates in ascending numerical order\.4\. For each candidate:\- Save the complete branch state\.\- Place the candidate and propagate again\.\- Recurse if the state remains consistent\.\- Restore the complete saved state if the branch fails\.5\. Backtrack when all candidates for the selected cell fail\.Restore the grid, used\-digit sets, and any maintained candidate state during rollback\. Never allow deductions from a failed branch to leak into another branch\.\#\# Verify IndependentlyBefore returning a solution, perform a fresh check independent of the search state:\- The result has exactly nine rows and nine entries per row\.\- Every entry is an integer from ‘1‘ through ‘9‘\.\- Every given remains unchanged in its original position\.\- Every row contains each digit ‘1‘ through ‘9‘ exactly once\.\- Every column contains each digit ‘1‘ through ‘9‘ exactly once\.\- Every 3x3 box contains each digit ‘1‘ through ‘9‘ exactly once\.\- No empty marker or placeholder remains\.Do not emit a grid unless every check passes\.\#\# Output ContractOn success, return exactly one ‘<answer\>‘ element containing exactly one Python code block\. The code block must contain a tuple of nine 9\-element tuples in row\-major order:<answer\>‘‘‘python\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)‘‘‘</answer\>Apply these formatting rules strictly:\- Emit no prose, headings, reasoning, or verification report outside the ‘<answer\>‘ element\.\- Use integer literals, not strings\.\- Use parentheses, not square brackets\.\- Return one complete grid and no intermediate grids\.If the puzzle is unsatisfiable or the available execution time expires before a verified solution is found, return exactly:‘‘‘textUNSOLVED\_WITHIN\_TIME‘‘‘Sudoku\-GPT\-5\-nano\-Skill\-4\# Solve SudokuComplete the puzzle with constraint propagation and backtracking\. Preserve every given digit, validate the finished grid independently, and keep all reasoning private\.\#\# Parse the Grid1\. Extract exactly nine rows with exactly nine cells per row\.2\. Interpret ‘X‘ as an empty cell\.3\. Interpret digits ‘1‘ through ‘9‘ as immutable givens\.4\. Record the givens separately for final verification\.5\. Confirm that the givens contain no duplicate digit in any row, column, or 3x3 box\.Use zero\-based row and column indices\. Identify the box containing ‘\(r, c\)‘ with:Sudoku\-GPT\-5\-nano\-Skill\-4 \(continued\)‘‘‘textbox\(r, c\) = 3 \* \(r // 3\) \+ \(c // 3\)‘‘‘Never alter a given to repair a contradiction\.\#\# Maintain ConstraintsTrack the digits already present in each row, column, and box:\- ‘row\_used\[r\]‘\- ‘col\_used\[c\]‘\- ‘box\_used\[box\(r, c\)\]‘For each empty cell ‘\(r, c\)‘, compute:‘‘‘textcandidates\(r, c\) =1, 2, 3, 4, 5, 6, 7, 8, 9\- row\_used\[r\]\- col\_used\[c\]\- box\_used\[box\(r, c\)\]‘‘‘Treat either condition as a contradiction:\- An empty cell has no candidate\.\- A digit is duplicated in a row, column, or box\.Update all affected constraints after every placement\.\#\# Propagate Forced MovesRepeat until a complete pass makes no progress:1\. Fill every naked single: an empty cell with exactly one candidate\.2\. Fill every hidden single: a missing digit that can appear in only one cell of a row, column, or box\.3\. Recompute affected candidates after each placement\.4\. Stop the current branch immediately if a contradiction appears\.An incomplete grid with multiple candidates is a stalled deduction state, not a failure\. Continue with exact search\.\#\# Search to CompletionWhen propagation stalls:1\. Choose an empty cell with the fewest candidates\.2\. Break ties in row\-major order\.3\. Try its candidates in ascending order\.4\. Save the complete state before each trial placement\.5\. Place the trial digit, propagate forced moves, and recurse\.6\. If the branch contradicts a constraint, restore the complete saved state and try the next candidate\.7\. Backtrack when every candidate for the selected cell fails\.Restore the grid, used\-digit sets, and any cached candidate eliminations during rollback\. Never allow deductions from a failed branch to leak into another branch\. Do not stop at a logical stalemate or return a partial grid\.\#\# Verify IndependentlyBefore responding, check the completed grid from scratch:1\. It has exactly nine rows and nine entries per row\.2\. Every entry is an integer from ‘1‘ through ‘9‘\.3\. Every original given remains unchanged\.4\. Every row contains each digit from ‘1‘ through ‘9‘ exactly once\.5\. Every column contains each digit from ‘1‘ through ‘9‘ exactly once\.6\. Every 3x3 box contains each digit from ‘1‘ through ‘9‘ exactly once\.7\. No ‘X‘ or other placeholder remains\.Emit nothing until all checks pass\. If a branch produces a complete grid that fails verification, reject it and resume search\.\#\# Format the AnswerReturn exactly one ‘<answer\>‘ element containing only a Python tuple of nine 9\-element row\-tuples:‘‘‘text<answer\>\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),Sudoku\-GPT\-5\-nano\-Skill\-4 \(continued\)\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)</answer\>‘‘‘Apply these rules strictly:\- Emit no text, Markdown fence, reasoning, or verification report outside or inside the ‘<answer\>‘ element\.\- Use integer literals, not strings\.\- Use parentheses, not square brackets\.\- Return exactly one complete, verified grid\.Sudoku\-GPT\-5\-nano\-Skill\-5\# Solve SudokuComplete the puzzle with constraint propagation and deterministic backtracking\. Keep candidate lists, guesses, and search traces private\.\#\# Parse and Validate1\. Extract exactly nine rows with nine cells per row\.2\. Interpret digits ‘1‘ through ‘9‘ as immutable givens and the prompt’s blank marker as an empty cell\.3\. Record the givens separately for final verification\.4\. Confirm that no given digit is duplicated in any row, column, or 3x3 box\. Never repair an invalid puzzle by changing a given\.For zero\-based coordinates, identify a cell’s box with:‘‘‘textbox\(r, c\) = 3 \* \(r // 3\) \+ \(c // 3\)‘‘‘\#\# Maintain ConstraintsTrack the digits already used in each row, column, and box\. For every empty cell ‘\(r, c\)‘, compute:‘‘‘textcandidates\(r, c\) =1, 2, 3, 4, 5, 6, 7, 8, 9\- row\_used\[r\]\- col\_used\[c\]\- box\_used\[box\(r, c\)\]‘‘‘Treat either of these conditions as an immediate contradiction:\- An empty cell has no candidate\.\- A row, column, or box has a missing digit that cannot be placed in any of its empty cells\.\#\# Propagate Forced PlacementsRepeat until a full pass makes no progress:1\. Fill naked singles: empty cells with exactly one candidate\.2\. Fill hidden singles: missing digits that appear in exactly one candidate set within a row, column, or box\.3\. After every placement, update all affected constraints and check for a contradiction\.An incomplete grid after propagation is not a failure\. Continue with search\.\#\# Search DeterministicallyWhen propagation stalls:1\. Select an empty cell with the fewest candidates\.2\. Break ties in row\-major order\.3\. Try its candidates in ascending numerical order\.4\. For each candidate, copy or checkpoint the complete branch state, place the candidate, propagate forced placements, and recurse\.5\. On contradiction, restore the complete checkpoint before trying the next candidate\.Do not allow assignments or candidate eliminations from a failed branch to leak into another branch\. Continue until a complete solution is found\.\#\# Verify IndependentlyBefore answering, perform a fresh validation independent of the search state:\- The result contains exactly nine rows of nine integer digits\.\- Every value is in ‘1\.\.9‘\.\- Every original given remains unchanged\.\- Every row equals the set ‘1, 2, 3, 4, 5, 6, 7, 8, 9‘\.\- Every column equals that set\.Sudoku\-GPT\-5\-nano\-Skill\-5 \(continued\)\- Every 3x3 box equals that set\.\- No blank marker remains\.Never emit a partial or unverified grid\.\#\# Format the AnswerReturn exactly one ‘<answer\>‘ element containing exactly one Python code block\. Inside the code block, return one outer tuple containing nine inner tuples in row\-major order:<answer\>‘‘‘python\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)‘‘‘</answer\>Apply these rules strictly:\- Emit nothing before or after the ‘<answer\>‘ element\.\- Use integer literals, not strings\.\- Use tuples, not lists\.\- Return only the final grid; omit explanations and verification notes\.Sudoku\-GPT\-5\-nano\-Skill\-6\# Solve SudokuComplete the puzzle with constraint propagation and exact backtracking\. Treat every given digit as immutable, keep all intermediate reasoning private, and emit only a fully verified solution\.\#\# Parse the Grid1\. Extract exactly nine rows with exactly nine cells per row\.2\. Interpret ‘X‘ as an empty cell\.3\. Interpret digits ‘1‘ through ‘9‘ as fixed clues\.4\. Record the clues separately for final verification\.5\. Confirm that the clues contain no duplicate digit in any row, column, or 3x3 box\.Use zero\-based indices internally\. Map cell ‘\(r, c\)‘ to:‘‘‘textbox\(r, c\) = 3 \* \(r // 3\) \+ \(c // 3\)‘‘‘Never alter a clue to repair a contradiction\.\#\# Maintain ConstraintsTrack the digits currently assigned in each unit:\- ‘row\_used\[r\]‘\- ‘col\_used\[c\]‘\- ‘box\_used\[box\(r, c\)\]‘For every empty cell ‘\(r, c\)‘, compute:‘‘‘textcandidates\(r, c\) =1, 2, 3, 4, 5, 6, 7, 8, 9\- row\_used\[r\]\- col\_used\[c\]\- box\_used\[box\(r, c\)\]‘‘‘After each placement, update all three unit constraints and every affected candidate set\. Treat either condition as a contradiction:\- An empty cell has no candidates\.\- A digit appears twice in a row, column, or box\.An incomplete grid with multiple candidates is a stalled deduction state, not a failure\.Sudoku\-GPT\-5\-nano\-Skill\-6 \(continued\)\#\# Propagate Forced MovesRepeat until a full pass makes no progress:1\. Fill each naked single: a cell with exactly one candidate\.2\. Fill each hidden single: a missing digit that occurs in only one candidate set within a row, column, or box\.3\. Apply only sound candidate eliminations, such as locked candidates or naked pairs, when they are tracked explicitly\.4\. Recompute affected candidates after every placement or elimination\.5\. Abandon the current branch immediately if a contradiction appears\.Do not make a placement merely because it looks plausible\. Every deterministic placement must follow from the current constraints\.\#\# Search to CompletionWhen propagation stalls, use depth\-first search:1\. Select an empty cell with the fewest candidates\.2\. Break ties in row\-major order\.3\. Try candidate digits in ascending order\.4\. Save the complete state before each trial\.5\. Place the trial digit, propagate forced moves, and recurse\.6\. If the branch fails, restore the complete saved state before trying the next candidate\.7\. Backtrack when all candidates for the selected cell fail\.Restore the grid, used\-digit sets, and all cached candidate eliminations\. Never allow deductions from a failed branch to leak into another branch\. Do not stop at a logical stalemate or return a partial grid\.\#\# Verify IndependentlyBefore formatting the answer, validate the completed grid from scratch rather than trusting the search state:1\. Confirm that the grid has exactly nine rows and nine entries per row\.2\. Confirm that every entry is an integer from ‘1‘ through ‘9‘\.3\. Confirm that every original clue remains at its original position\.4\. Confirm that each row contains every digit from ‘1‘ through ‘9‘ exactly once\.5\. Confirm that each column contains every digit from ‘1‘ through ‘9‘ exactly once\.6\. Confirm that each 3x3 box contains every digit from ‘1‘ through ‘9‘ exactly once\.7\. Confirm that no ‘X‘, zero, string, or other placeholder remains\.Reject any completed grid that fails a check and resume search\. Never emit an unverified grid\.\#\# Format the AnswerReturn exactly one ‘<answer\>‘ element\. Place exactly one Python code block inside it, containing a tuple of nine 9\-element tuples in row\-major order:<answer\>‘‘‘python\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)‘‘‘</answer\>Apply these rules strictly:\- Emit no text before or after the ‘<answer\>‘ element\.\- Emit no reasoning, notes, headings, or verification report in the answer\.\- Put only the Python code block inside the tags\.\- Use integer literals, not strings\.\- Use parentheses, not square brackets\.\- Return exactly one complete, verified grid\.Sudoku\-GPT\-5\-nano\-Skill\-7\# Solve SudokuProduce the valid completed grid while preserving every clue\.\#\# Parse the puzzle1\. Extract exactly nine rows of nine cells from the prompt, ignoring surrounding prose and whitespace\.2\. Treat each ‘X‘ as an empty cell and each digit ‘1‘–‘9‘ as an immutable clue\.3\. Reject no clue silently\. If the input is malformed or the clues already violate a row, column, or box constraint, do not invent a solution\.\#\# Solve1\. For every empty cell, track the digits absent from its row, column, and 3×3 box\.2\. Repeatedly place naked singles and hidden singles\.3\. When propagation stalls, choose an unfilled cell with the fewest candidates and try its candidates in ascending order\.4\. After each trial placement, propagate constraints again\. Backtrack immediately on any cell with no candidate or any duplicated digit in a unit\.5\. Continue until the grid is complete\. The task set is expected to contain a valid, unique solution\.\#\# VerifyBefore responding, confirm all of the following:\- The grid has exactly nine rows and nine integers per row\.\- Every value is an integer from ‘1‘ through ‘9‘\.\- Every original clue remains unchanged in its original position\.\- Every row, column, and 3×3 box has the set ‘1, 2, 3, 4, 5, 6, 7, 8, 9‘\.\- No ‘X‘, placeholder, string, or list remains\.Do not emit an unverified grid\.\#\# Return the resultReturn only one Python tuple\-of\-tuples enclosed by ‘<answer\>‘ and ‘</answer\>‘\. Include no explanation, label, Markdown fence, or other text\.Use this exact shape:‘‘‘text<answer\>\(\(d11, d12, d13, d14, d15, d16, d17, d18, d19\),\(d21, d22, d23, d24, d25, d26, d27, d28, d29\),\(d31, d32, d33, d34, d35, d36, d37, d38, d39\),\(d41, d42, d43, d44, d45, d46, d47, d48, d49\),\(d51, d52, d53, d54, d55, d56, d57, d58, d59\),\(d61, d62, d63, d64, d65, d66, d67, d68, d69\),\(d71, d72, d73, d74, d75, d76, d77, d78, d79\),\(d81, d82, d83, d84, d85, d86, d87, d88, d89\),\(d91, d92, d93, d94, d95, d96, d97, d98, d99\)\)</answer\>‘‘‘Replace every ‘drc‘ placeholder with the solved integer at row ‘r‘, column ‘c‘\.Sudoku\-GPT\-5\-nano\-Skill\-8\# Solve SudokuSolve the puzzle with constraint propagation and deterministic backtracking\. Preserve every given clue\. Keep all reasoning, candidates, and search traces private\.\#\# Parse and Validate1\. Extract exactly nine rows containing exactly nine cells each\.2\. Interpret ‘X‘ as an empty cell and digits ‘1‘ through ‘9‘ as immutable givens\.3\. Record the givens separately for final verification\.4\. Reject malformed input or givens that already duplicate a digit in any row, column, or 3x3 box\. Never modify a given to repair a contradiction\.For zero\-based coordinates, identify the box containing ‘\(r, c\)‘ with:‘‘‘textbox\(r, c\) = 3 \* \(r // 3\) \+ \(c // 3\)‘‘‘\#\# Maintain ConstraintsSudoku\-GPT\-5\-nano\-Skill\-8 \(continued\)Track the digits already used in every row, column, and box:\- ‘row\_used\[r\]‘\- ‘col\_used\[c\]‘\- ‘box\_used\[box\(r, c\)\]‘For each empty cell ‘\(r, c\)‘, compute:‘‘‘textcandidates\(r, c\) =1, 2, 3, 4, 5, 6, 7, 8, 9\- row\_used\[r\]\- col\_used\[c\]\- box\_used\[box\(r, c\)\]‘‘‘Treat any of these conditions as a contradiction:\- An empty cell has no candidate\.\- A row, column, or box contains a duplicate digit\.\- A missing digit has no legal position in a row, column, or box\.\#\# Propagate and Track ProgressDefine one propagation cycle as one complete sweep over the grid and its rows, columns, and boxes\. During each cycle:1\. Place naked singles: empty cells with exactly one candidate\.2\. Place hidden singles: missing digits that have exactly one legal position within a row, column, or box\.3\. Update affected constraint state immediately after every placement\.4\. Stop the current branch immediately if a contradiction appears\.5\. Record whether the cycle placed at least one digit\.Maintain a branch\-local ‘stagnation\_count‘:\- Reset it to ‘0‘ after any cycle that places a digit\.\- Increment it after a cycle that places no digit\.\- Never continue propagation after it reaches ‘60‘\.A no\-progress cycle normally means that propagation has reached a fixed point; continue that branch with exact search instead of repeating an unchanged sweep\. The 60\-cycle limit is a defensive hard stop against accidental repetition\. If the same branch nevertheless reaches 60 consecutive no\-progress cycles, abandon it as failed\. If no branch remains, return the failure signal defined below\.\#\# Search DeterministicallyWhen propagation stalls before the grid is complete:1\. Select an empty cell with the fewest candidates\.2\. Break ties in row\-major order\.3\. Try candidate digits in ascending order\.4\. Save the complete branch state before each trial\.5\. Place the candidate, reset that child branch’s ‘stagnation\_count‘ to ‘0‘, propagate forced placements, and recurse\.6\. On contradiction or branch failure, restore the complete saved state and try the next candidate\.7\. Backtrack when every candidate for the selected cell fails\.Restore the grid, used\-digit sets, cached candidates, and progress counter during rollback\. Never let state from a failed branch leak into another branch\. Do not treat an ordinary logical stalemate as proof that the puzzle is unsolvable\.\#\# Verify IndependentlyBefore answering, validate the completed grid from scratch:\- It has exactly nine rows and nine integer entries per row\.\- Every entry is between ‘1‘ and ‘9‘\.\- Every original given remains unchanged\.\- Every row contains the digits ‘1‘ through ‘9‘ exactly once\.\- Every column contains the digits ‘1‘ through ‘9‘ exactly once\.\- Every 3x3 box contains the digits ‘1‘ through ‘9‘ exactly once\.\- No ‘X‘ or other placeholder remains\.Reject any completed branch that fails a check and resume search\. Never emit a partial or unverified grid\.\#\# Format the Final OutputOn success, emit exactly one ‘<answer\>‘ element containing exactly one Python code block:<answer\>‘‘‘python\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),Sudoku\-GPT\-5\-nano\-Skill\-8 \(continued\)\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)‘‘‘</answer\>Apply these rules strictly:\- Emit nothing before or after the ‘<answer\>‘ element\.\- Use integer literals, not strings\.\- Use tuples, not lists\.\- Return exactly one complete grid\.\- Omit explanations and verification notes\.If the input is malformed, exhaustive search proves that no solution exists, or all remaining branches hit the stagnation cap, emit exactly:‘‘‘text<answer\>UNSOLVABLE</answer\>‘‘‘Never emit both a grid and a failure signal\.Sudoku\-GPT\-5\-nano\-Skill\-9\# Solve SudokuComplete the puzzle with constraint propagation and exact backtracking\. Keep candidate lists, guesses, and search traces private\. Return only a verified solution in the required format\.\#\# Parse and Validate the Grid1\. Extract exactly nine rows with exactly nine cells per row\.2\. Interpret ‘X‘, ‘\.‘, and ‘0‘ as empty cells\.3\. Interpret digits ‘1‘ through ‘9‘ as immutable givens\.4\. Record the givens separately for final verification\.5\. Reject malformed input or givens that already repeat a digit within a row, column, or 3x3 box\.Use zero\-based row and column indices\. Identify the box containing ‘\(r, c\)‘ as:‘‘‘textbox\(r, c\) = 3 \* \(r // 3\) \+ \(c // 3\)‘‘‘Never change a given to repair a contradiction\.\#\# Maintain ConstraintsTrack:\- ‘row\_used\[r\]‘: digits assigned in row ‘r‘\- ‘col\_used\[c\]‘: digits assigned in column ‘c‘\- ‘box\_used\[b\]‘: digits assigned in box ‘b‘For every empty cell ‘\(r, c\)‘, compute:“‘textcandidates\(r, c\) =1, 2, 3, 4, 5, 6, 7, 8, 9\- row\_used\[r\]\- col\_used\[c\]\- box\_used\[box\(r, c\)\]“‘After every placement, update the grid and all affected constraint state\. Treat either condition as a contradiction:\- An empty cell has no candidate\.\- A row, column, or box contains a duplicate digit\.\- A missing digit has no legal position in a row, column, or box\.An incomplete consistent grid is a stalled state, not a failure\.\#\# Propagate Forced PlacementsRepeat until a complete pass makes no progress:1\. Place every naked single: an empty cell with exactly one candidate\.2\. Place every hidden single: a missing digit that can occur in exactly one empty cell of a row, column, or box\.Sudoku\-GPT\-5\-nano\-Skill\-9 \(continued\)3\. Recompute affected candidates after each placement\.4\. Stop the current branch immediately when a contradiction appears\.Process cells and units in row\-major order whenever an ordering choice is needed\.\#\# Search to CompletionWhen propagation stalls before the grid is complete:1\. Choose an empty cell with the fewest candidates \(MRV\)\.2\. Break ties in row\-major order\.3\. Try candidate digits in ascending order\.4\. Save the complete branch state before each trial placement\.5\. Place the candidate, propagate forced placements, and recurse\.6\. If the branch contradicts a constraint, restore the saved state and try the next candidate\.7\. Backtrack when every candidate for the selected cell fails\.Restore the grid, used\-digit sets, and any cached candidate state during rollback\. Never allow deductions from a failed branch to leak into another branch\. Do not stop at a logical stalemate and do not return a partial grid\.\#\# Verify IndependentlyBefore formatting the answer, check the completed grid from scratch:1\. Confirm that it contains exactly nine rows and nine entries per row\.2\. Confirm that every entry is an integer from ‘1‘ through ‘9‘\.3\. Confirm that every original given remains unchanged\.4\. Confirm that every row contains each digit from ‘1‘ through ‘9‘ exactly once\.5\. Confirm that every column contains each digit from ‘1‘ through ‘9‘ exactly once\.6\. Confirm that every 3x3 box contains each digit from ‘1‘ through ‘9‘ exactly once\.7\. Confirm that no empty marker remains\.Reject any completed branch that fails verification and resume search\. Never emit an unverified grid\.\#\# Output ContractOn success, emit exactly one ‘<answer\>‘ element containing only a Python tuple of nine 9\-element row\-tuples:‘‘‘text<answer\>\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)</answer\>‘‘‘Apply these rules strictly:\- Emit no prose, Markdown fence, reasoning, or verification report\.\- Use integer literals, not strings\.\- Use parentheses, not square brackets\.\- Return exactly one complete, verified grid\.If the input is malformed or exhaustive search proves that no solution exists, emit exactly:‘‘‘text<failure\>UNSOLVABLE\_OR\_INVALID\_PUZZLE</failure\>‘‘‘Do not emit both an answer and a failure signal\.Sudoku\-GPT\-5\-nano\-Skill\-10\# Solve SudokuComplete the puzzle with constraint propagation and deterministic backtracking\. Keep all reasoning, candidate lists, and search traces private\.\#\# Parse and Validate1\. Extract exactly nine rows with exactly nine cells per row\.2\. Interpret ‘X‘ as an empty cell and digits ‘1‘ through ‘9‘ as immutable givens\.3\. Record the givens separately for final verification\.4\. Reject malformed input or any puzzle whose givens already duplicate a digit in a row, column, or 3x3 box\. Never alter a given to repair a contradiction\.Do not reject a puzzle merely because it has fewer than 17 givens\. Clue count alone does not determine whether a supplied puzzle has a valid completion\.For zero\-based coordinates, identify a cell’s box with:‘‘‘textbox\(r, c\) = 3 \* \(r // 3\) \+ \(c // 3\)‘‘‘\#\# Maintain ConstraintsTrack the digits already used in each row, column, and box:\- ‘row\_used\[r\]‘\- ‘col\_used\[c\]‘\- ‘box\_used\[box\(r, c\)\]‘For each empty cell ‘\(r, c\)‘, compute:‘‘‘textcandidates\(r, c\) =1, 2, 3, 4, 5, 6, 7, 8, 9\- row\_used\[r\]\- col\_used\[c\]\- box\_used\[box\(r, c\)\]‘‘‘Treat either condition as a contradiction:\- An empty cell has no candidate\.\- A row, column, or box has a missing digit that cannot be placed in any of its empty cells\.\#\# Propagate Forced PlacementsRepeat until a complete pass makes no progress:1\. Fill every naked single: an empty cell with exactly one candidate\.2\. Fill every hidden single: a missing digit that can occur in only one empty cell of a row, column, or box\.3\. Update all affected constraints after every placement\.4\. Stop the current branch immediately if a contradiction appears\.Treat stalled propagation as an incomplete state, not a failure\. Continue with exact search\.\#\# Search DeterministicallyWhen propagation stalls:1\. Select an empty cell with the fewest candidates\.2\. Break ties in row\-major order\.3\. Try candidates in ascending numerical order\.4\. Before each trial, save the complete branch state\.5\. Place the candidate, propagate forced placements, and recurse\.6\. On contradiction, restore the complete saved state and try the next candidate\.7\. Backtrack when every candidate for the selected cell fails\.Restore the grid, used\-digit sets, and any cached candidate state during rollback\. Never allow deductions from a failed branch to leak into another branch\.\#\# Verify IndependentlyBefore answering, validate the completed grid from scratch:\- It has exactly nine rows and nine entries per row\.\- Every entry is an integer from ‘1‘ through ‘9‘\.\- Every original given remains unchanged\.\- Every row contains each digit ‘1‘ through ‘9‘ exactly once\.\- Every column contains each digit ‘1‘ through ‘9‘ exactly once\.\- Every 3x3 box contains each digit ‘1‘ through ‘9‘ exactly once\.\- No ‘X‘ or other placeholder remains\.Reject a completed branch that fails any check and resume search\. Never emit a partial or unverified grid\.Sudoku\-GPT\-5\-nano\-Skill\-10 \(continued\)\#\# Format the AnswerOn success, return exactly one ‘<answer\>‘ element containing exactly one Python code block\. Inside the code block, return one outer tuple containing nine 9\-element row\-tuples in row\-major order:<answer\>‘‘‘python\(\(r1c1, r1c2, r1c3, r1c4, r1c5, r1c6, r1c7, r1c8, r1c9\),\(r2c1, r2c2, r2c3, r2c4, r2c5, r2c6, r2c7, r2c8, r2c9\),\(r3c1, r3c2, r3c3, r3c4, r3c5, r3c6, r3c7, r3c8, r3c9\),\(r4c1, r4c2, r4c3, r4c4, r4c5, r4c6, r4c7, r4c8, r4c9\),\(r5c1, r5c2, r5c3, r5c4, r5c5, r5c6, r5c7, r5c8, r5c9\),\(r6c1, r6c2, r6c3, r6c4, r6c5, r6c6, r6c7, r6c8, r6c9\),\(r7c1, r7c2, r7c3, r7c4, r7c5, r7c6, r7c7, r7c8, r7c9\),\(r8c1, r8c2, r8c3, r8c4, r8c5, r8c6, r8c7, r8c8, r8c9\),\(r9c1, r9c2, r9c3, r9c4, r9c5, r9c6, r9c7, r9c8, r9c9\)\)‘‘‘</answer\>Apply these rules strictly:\- Emit nothing before or after the ‘<answer\>‘ element\.\- Use integer literals, not strings\.\- Use tuples, not lists\.\- Return exactly one complete grid; omit explanations and verification notes\.If exhaustive search proves that the puzzle has no solution, return exactly:‘‘‘textUNSOLVABLE‘‘‘HMMT\-GPT\-5\-nano\-Example\-Output\[Question\]Let⌊z⌋\\lfloor z\\rfloordenote the greatest integer less than or equal tozz\. Compute∑j=−10001000⌊2025j\+0\.5⌋\.\\sum\_\{j=\-1000\}^\{1000\}\\left\\lfloor\\frac\{2025\}\{j\+0\.5\}\\right\\rfloor\.\[Zero\-shot Response\]LetS=∑j=−10001000⌊2025j\+1/2⌋\.S=\\sum\_\{j=\-1000\}^\{1000\}\\left\\lfloor\\frac\{2025\}\{j\+1/2\}\\right\\rfloor\.Pair the terms forj∈\{−1000,…,999\}j\\in\\\{\-1000,\\ldots,999\\\}withk=−j−1k=\-j\-1\. Thenj\+1/2j\+1/2andk\+1/2k\+1/2are opposites, so witha=j\+1/2a=j\+1/2, we have⌊2025a⌋\+⌊2025−a⌋=⌊x⌋\+⌊−x⌋,\\left\\lfloor\\frac\{2025\}\{a\}\\right\\rfloor\+\\left\\lfloor\\frac\{2025\}\{\-a\}\\right\\rfloor=\\lfloor x\\rfloor\+\\lfloor\-x\\rfloor,wherex=2025a=40502​j\+1\.x=\\frac\{2025\}\{a\}=\\frac\{4050\}\{2j\+1\}\.If2​j\+12j\+1divides40504050, thenxxis an integer and the pair sums to00\. Otherwise,⌊x⌋\+⌊−x⌋=−1\.\\lfloor x\\rfloor\+\\lfloor\-x\\rfloor=\-1\.Amongj∈\{−1000,…,999\}j\\in\\\{\-1000,\\ldots,999\\\}, the number of pairs is500500\. The pair sums are00precisely for thosejjwith2​j\+12j\+1dividing40504050\. The value4050=2⋅34⋅52,4050=2\\cdot 3^\{4\}\\cdot 5^\{2\},so the odd divisors of40504050are exactly the divisors of34⋅523^\{4\}\\cdot 5^\{2\}, giving1515positive divisors, including11\. Among these, the only divisor with magnitude greater than19991999is20252025, so the divisors satisfying\|d\|≤1999\|d\|\\leq 1999consist of1414positive and1414negative divisors, giving2828possible values of2​j\+12j\+1\. Each pair corresponds to two values ofjj, namely those associated withddand−d\-d, so the number of pairs with sum00is28/2=1428/2=14\.HMMT\-GPT\-5\-nano\-Example\-Output \(continued\)Thus, the sum over the500500pairs is−\(500−14\)=−486\.\-\(500\-14\)=\-486\.The remaining unpaired term isj=1000j=1000:⌊20251000\.5⌋=⌊40502001⌋=2\.\\left\\lfloor\\frac\{2025\}\{1000\.5\}\\right\\rfloor=\\left\\lfloor\\frac\{4050\}\{2001\}\\right\\rfloor=2\.Therefore,S=−486\+2=−484\.S=\-486\+2=\-484\.−484\\boxed\{\-484\}Incorrect\[DIVEResponse\]First rewrite the sum usingtj=j\+1/2t\_\{j\}=j\+1/2\. Thentjt\_\{j\}runs over−999\.5,−998\.5,…,−0\.5,0\.5,…,999\.5\-999\.5,\-998\.5,\\ldots,\-0\.5,0\.5,\\ldots,999\.5and includes the additional value1000\.51000\.5forj=1000j=1000\.Pair the terms corresponding tottand−t\-tfort=0\.5,1\.5,…,999\.5\.t=0\.5,1\.5,\\ldots,999\.5\.For each pair, seta=2025t\>0\.a=\\frac\{2025\}\{t\}\>0\.Then⌊a⌋\+⌊−a⌋=\{0,a∈ℤ,−1,a∉ℤ\.\\lfloor a\\rfloor\+\\lfloor\-a\\rfloor=\\begin\{cases\}0,&a\\in\\mathbb\{Z\},\\\\ \-1,&a\\notin\\mathbb\{Z\}\.\\end\{cases\}Thus, among the10001000pairs, each contributes−1\-1except whenaais an integer\. Nowaais an integer exactly whent=d/2t=d/2, whereddis an odd divisor of40504050\. The positive odd divisors of40504050are3α​5β,0≤α≤4,0≤β≤2,3^\{\\alpha\}5^\{\\beta\},\\qquad 0\\leq\\alpha\\leq 4,\\quad 0\\leq\\beta\\leq 2,giving1515divisors in total\. The largest is20252025, which corresponds tot=20252=1012\.5,t=\\frac\{2025\}\{2\}=1012\.5,outside the range0\.5≤t≤999\.50\.5\\leq t\\leq 999\.5\. Therefore, exactly1414pairs contribute00, while the remaining986986pairs contribute−1\-1\. Hence the paired terms sum to−986\.\-986\.The remaining unpaired term corresponds tot=1000\.5t=1000\.5:⌊20251000\.5⌋=⌊40502001⌋=2\.\\left\\lfloor\\frac\{2025\}\{1000\.5\}\\right\\rfloor=\\left\\lfloor\\frac\{4050\}\{2001\}\\right\\rfloor=2\.Therefore, the total is−986\+2=−984\.\-986\+2=\-984\.−984\\boxed\{\-984\}CorrectSudoku\-GPT\-5\-nano\-Example\-Output\[Question\]This is a standard9×99\\times 9Sudoku, whereXneeds to be filled with digits11–99:```
XX35X6XXX
768XX25XX
5X2X71XXX
8XXXX3X5X
XX5X1XXX9
XX19XX36X
XX9X3XXXX
XX7X5XX2X
XX42XX837
```

Please complete this Sudoku\.Please solve according to Sudoku rules: the numbers11–99must appear exactly once in each row, column, and3×33\\times 3box\.Please provide your answer at the end using a Python Markdown code block, represented as a tuple, for example:```
‘‘‘python
((1,2,3,4,5,6,7,8,9),(4,5,6,7,8,9,1,2,3),...)
‘‘‘
```

\[Zero\-shot Response\]```
‘‘‘python
((9, 1, 3, 5, 4, 6, 7, 8, 2),
 (7, 6, 8, 4, 9, 2, 5, 1, 3),
 (5, 4, 2, 3, 7, 1, 6, 9, 8),
 (8, 9, 6, 7, 2, 3, 4, 5, 1),
 (4, 3, 5, 6, 1, 8, 2, 7, 9),
 (2, 7, 1, 9, 8, 5, 3, 6, 4),
 (6, 2, 9, 8, 3, 7, 1, 4, 5),
 (3, 8, 7, 1, 5, 4, 9, 2, 6),
 (1, 5, 4, 2, 6, 9, 8, 3, 7))
‘‘‘
```

Incorrect\[DIVEResponse\]```
‘‘‘python
((9, 1, 3, 5, 4, 6, 2, 7, 8),
 (7, 6, 8, 3, 9, 2, 5, 1, 4),
 (5, 4, 2, 8, 7, 1, 6, 9, 3),
 (8, 9, 6, 4, 2, 3, 7, 5, 1),
 (2, 3, 5, 6, 1, 7, 4, 8, 9),
 (4, 7, 1, 9, 8, 5, 3, 6, 2),
 (6, 2, 9, 7, 3, 8, 1, 4, 5),
 (3, 8, 7, 1, 5, 4, 9, 2, 6),
 (1, 5, 4, 2, 6, 9, 8, 3, 7))
‘‘‘
```

Correct

相似文章

跨模态技能注入研究:场景、方法与超参数

arXiv cs.CL

本文系统研究了跨模态技能注入,将领域专家大语言模型融入视觉语言模型以激发新兴多模态能力。评估了不同场景(指令遵循、跨语言、数学推理)、融合方法(TA、DARE等)及超参数,发现TA和DARE在除数学推理外表现良好。