Beyond Top-$k$ Skill Retrieval: Diversity-Aware Skill Routing for LLM Agents

arXiv cs.AI Papers

Summary

This paper proposes Diverse Skill Routing (DSR), a diversity-aware reranking framework using Determinantal Point Processes to balance relevance and non-redundancy in skill selection for LLM agents, improving recall and coverage on benchmarks.

arXiv:2609.05824v1 Announce Type: new Abstract: Large language model (LLM) agents increasingly rely on external skills, but routing user requests over large skill registries is difficult because many skills are functionally redundant while complex tasks often require complementary skill sets. Existing skill routers typically rank candidates independently by query relevance, which can waste context budget on redundant skills. We propose Diverse Skill Routing (DSR), a diversity-aware reranking framework that uses a Determinantal Point Process to balance relevance and non-redundancy. DSR introduces a query-residual diversity kernel that penalizes redundant skill overlap while reducing penalties caused only by shared query relevance. On the SkillRouter benchmark, DSR improves recall and full coverage over a strong pointwise reranking baseline, with larger gains on multi-skill queries. These results suggest that skill routing should be treated not only as relevance ranking, but also as complementary set selection.
Original Article
View Cached Full Text

Cached at: 09/10/26, 08:43 AM

# Diversity-Aware Skill Routing for LLM Agents
Source: [https://arxiv.org/html/2609.05824](https://arxiv.org/html/2609.05824)
## Beyond Top\-kkSkill Retrieval: Diversity\-Aware Skill Routing for LLM Agents

Tiankai YangAffiliation:University of Southern CaliforniaEmail:[hdardiry@vt\.edu](mailto:)Samyadeep BasuAffiliation:Adobe ResearchHongjie ChenAffiliation:Dolby LabsYue ZhaoAffiliation:University of Southern CaliforniaZhengzhong TuAffiliation:Texas A&M UniversityXiyang HuAffiliation:Arizona State UniversityFranck DernoncourtAffiliation:Adobe ResearchRyan A\. RossiAffiliation:Adobe ResearchHoda Eldardiry††thanks:Corresponding author\.Affiliation:Virginia Tech

###### Abstract

Large language model \(LLM\) agents increasingly rely on external skills, but routing user requests over large skill registries is difficult because many skills are functionally redundant while complex tasks often require complementary skill sets\. Existing skill routers typically rank candidates independently by query relevance, which can waste context budget on redundant skills\. We propose Diverse Skill Routing \(DSR\), a diversity\-aware reranking framework that uses a Determinantal Point Process to balance relevance and non\-redundancy\. DSR introduces a query\-residual diversity kernel that penalizes redundant skill overlap while reducing penalties caused only by shared query relevance\. On the SkillRouter benchmark, DSR improves recall and full coverage over a strong pointwise reranking baseline, with larger gains on multi\-skill queries\. These results suggest that skill routing should be treated not only as relevance ranking, but also as complementary set selection\.

## 1Introduction

Large language model \(LLM\) agents increasingly rely on external tools and skills to solve tasks that require capabilities beyond direct text generation\. Early tool\-use systems showed that language models can learn when and how to call external APIs\([Schick et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib1)\), while subsequent agent frameworks use LLMs to decompose user requests, select external models or tools, and aggregate their outputs\([Shen et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib2);[Qin et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib3)\)\. More recently, skill\-based agents organize procedural knowledge into reusable modules, such as instructions, scripts, examples, and reference documents, that can be loaded into context at inference time\([Wang et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib4);[Xu and Yan, 2026](https://arxiv.org/html/2609.05824#bib.bib5)\)\. This design makes agents more extensible, since new capabilities can be added through external skill libraries rather than model retraining\.

However, the growth of skill libraries creates a new routing bottleneck\. When thousands or tens of thousands of skills are available, it is infeasible to expose all of them to the agent because the context window is limited, and irrelevant skills may distract execution\. Recent work on skill routing studies this problem directly by retrieving task\-relevant skills from large registries\. SkillRouter, for example, evaluates skill selection over an approximately 80K\-skill pool and shows that full skill implementations contain important routing signals beyond names and descriptions\([Zheng et al\., 2026](https://arxiv.org/html/2609.05824#bib.bib6)\)\. SkillsBench further highlights that curated skills can improve agent performance, but their benefit depends strongly on task and skill quality\([Li et al\., 2026](https://arxiv.org/html/2609.05824#bib.bib7)\)\. These findings suggest that skill selection is becoming a central component of practical LLM\-agent systems\.

Existing skill routers typically formulate selection as a pointwise retrieval or reranking problem: each candidate skill is scored independently against the query, and the top\-ranked skills are returned\. This is natural for single\-skill tasks, where success depends on finding one correct skill\. However, many realistic agent tasks are compositional\. A user request may require several complementary skills, such as document parsing, information extraction, data transformation, and visualization\. In such cases, independent top\-kkretrieval can return redundant shortlists: several skills may have similar descriptions or implementations and therefore receive high relevance scores, while other necessary but different skills are omitted\. This wastes limited context budget and weakens the agent’s ability to cover all parts of a multi\-step workflow\.

We argue that large\-scale skill routing should be treated not only as relevance ranking, but also as complementary set selection\. This perspective is related to diversity\-aware retrieval, where the goal is to select items that are both individually useful and mutually non\-redundant\. Determinantal Point Processes \(DPPs\) provide a principled probabilistic model for such subset selection problems by favoring sets with high item quality and high diversity\([Kulesza and Taskar, 2012](https://arxiv.org/html/2609.05824#bib.bib15)\)\. DPPs have been widely used for selecting diverse high\-quality subsets, but applying them directly to skill routing is non\-trivial\. In skill routing, two skills may be similar because they are redundant, but they may also be similar because both are relevant to the same query while still covering different steps of the task\. Penalizing all similarity uniformly can therefore remove useful complementary skills\.

To address this issue, we propose Diverse Skill Routing \(DSR\), a diversity\-aware reranking framework for large\-scale skill selection\. DSR builds on a standard retrieve\-and\-rerank pipeline: a retriever first produces candidate skills, and a quality model assigns query\-dependent relevance scores\. DSR then applies DPP\-based selection to construct a skill set that balances relevance and non\-redundancy\. The key component is a query\-residual diversity kernel, which measures inter\-skill redundancy after removing the component of each skill representation aligned with the query\. This design reduces the penalty on skills that are jointly relevant to the query, while still discouraging near\-duplicate candidates\. The selected skills are finally ordered by their quality scores to produce the ranked shortlist\.

We evaluate DSR on the SkillRouter benchmark\([Zheng et al\., 2026](https://arxiv.org/html/2609.05824#bib.bib6)\), which contains approximately 80K candidate skills and includes both single\-skill and multi\-skill queries\. Compared with a strong pointwise SkillRouter baseline, DSR improves recall and full coverage, with larger gains on multi\-skill queries and at larger cutoffs\. Ablations show that the query\-residual kernel is critical: replacing it with a standard inter\-skill similarity kernel substantially reduces multi\-skill full coverage\. These results suggest that, as skill registries continue to grow, effective routing should account for both relevance to the user request and diversity across the selected skill set\.

Our contributions are as follows:

- •We formulate large\-scale skill routing as a diversity\-aware subset selection problem, motivated by redundancy in large skill registries and the compositional structure of multi\-skill agent tasks\.
- •We propose DSR, a DPP\-based reranking framework that balances query\-dependent skill relevance with inter\-skill non\-redundancy\.
- •We introduce a query\-residual diversity kernel that distinguishes redundant overlap from similarity induced by shared query relevance\.
- •We show that DSR improves recall and full coverage over a strong pointwise SkillRouter baseline, with larger gains on multi\-skill queries\.

## 2Related Work

#### Tool use and skill\-augmented agents\.

A growing line of work studies how LLMs can use external tools and procedural knowledge to solve tasks beyond direct text generation\. Toolformer shows that language models can learn when and how to call external APIs through self\-supervised training signals\([Schick et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib1)\)\. HuggingGPT uses an LLM as a controller to decompose user requests, select expert models from Hugging Face, execute subtasks, and aggregate the results\([Shen et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib2)\)\. ToolLLM scales tool learning to thousands of real\-world APIs by constructing ToolBench and training models for tool\-use decision making\([Qin et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib3)\)\. Voyager studies an embodied setting where an LLM\-powered agent grows an executable skill library over time and retrieves relevant skills for new tasks\([Wang et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib4)\)\. These works demonstrate the value of external tools and skills, but they do not directly address how to select non\-redundant skill sets from very large skill registries\.

#### Skill routing and skill evaluation\.

Recent work has begun to study skills as a first\-class abstraction for LLM agents\.[Xu and Yan \(2026\)](https://arxiv.org/html/2609.05824#bib.bib5)describe agent skills as composable packages of instructions, code, and resources that can be loaded on demand\. SkillRouter directly studies large\-scale skill selection, showing that routing over tens of thousands of skills is difficult and that full skill implementations provide important routing signals beyond names and descriptions\([Zheng et al\., 2026](https://arxiv.org/html/2609.05824#bib.bib6)\)\. SkillsBench evaluates whether curated skills improve downstream agent performance and finds that skills can be beneficial, but their effects vary across tasks and domains\([Li et al\., 2026](https://arxiv.org/html/2609.05824#bib.bib7)\)\. Our work is complementary to these studies\. Rather than introducing a new skill benchmark or skill representation, we focus on the selection objective: given a candidate pool and relevance scores, how should the router construct a non\-redundant shortlist for multi\-skill tasks?

#### LLM routing\.

Routing across LLMs has emerged as a practical approach for improving performance under heterogeneous model capabilities and inference costs\. Cost\-aware systems such as FrugalGPT use cascaded routing to reduce inference cost while maintaining task performance\([Chen et al\., 2023](https://arxiv.org/html/2609.05824#bib.bib8)\)\. Other methods learn query\-dependent model selection policies or model representations\. EmbedLLM learns compact representations of LLMs that can support downstream applications such as model routing\([Zhuang et al\., 2025](https://arxiv.org/html/2609.05824#bib.bib9)\), while RouterDC uses dual contrastive learning to route queries to suitable LLMs\([Chen et al\., 2024](https://arxiv.org/html/2609.05824#bib.bib10)\)\. Recent work also studies routing benchmarks and learning settings, including RouterBench\([Hu et al\., 2024](https://arxiv.org/html/2609.05824#bib.bib11)\), RouterEval\([Huang et al\., 2025](https://arxiv.org/html/2609.05824#bib.bib12)\), RouteLLM\([Ong et al\., 2025](https://arxiv.org/html/2609.05824#bib.bib13)\), and BaRP\([Wang et al\., 2025](https://arxiv.org/html/2609.05824#bib.bib14)\)\. These methods motivate routing as a practical mechanism for efficient LLM deployment\. However, LLM routing usually selects one model, a cascade, or a small set of models, whereas skill routing often needs to expose several complementary skills to an agent at once\. This makes redundancy among selected items a central concern in skill routing\.

#### Diversity\-aware subset selection\.

Diversity has long been studied in retrieval, recommendation, and summarization\. Maximal Marginal Relevance balances query relevance with novelty to reduce redundancy in reranked document lists\([Carbonell and Goldstein, 1998](https://arxiv.org/html/2609.05824#bib.bib16)\), while later diversification methods explicitly model multiple query aspects\([Santos et al\., 2010](https://arxiv.org/html/2609.05824#bib.bib17)\)\. DPPs provide a probabilistic framework for subset selection problems that require balancing item quality and diversity\([Kulesza and Taskar, 2012](https://arxiv.org/html/2609.05824#bib.bib15)\)\. They have been used in settings such as document summarization\([Cho et al\., 2019](https://arxiv.org/html/2609.05824#bib.bib18)\), recommendation\([Wilhelm et al\., 2018](https://arxiv.org/html/2609.05824#bib.bib19)\), and information retrieval\([Affandi et al\., 2014](https://arxiv.org/html/2609.05824#bib.bib20);[Deng et al\., 2020](https://arxiv.org/html/2609.05824#bib.bib21)\)\. DPP MAP inference is generally challenging, and efficient greedy variants are commonly used for large\-scale settings\([Han et al\., 2017](https://arxiv.org/html/2609.05824#bib.bib22)\)\. Our work brings this diversity\-aware perspective to skill routing, where redundancy arises from overlapping procedural functionality\. Unlike standard applications that penalize raw inter\-item similarity, DSR computes diversity in a query\-residual space tailored to query\-conditioned skill selection\.

## 3Method

We now describe how to select a compact set of skills for a query from a large skill registry\. Given a user queryxxand a skill pool𝒮=\{s1,…,sN\}\\mathcal\{S\}=\\\{s\_\{1\},\\ldots,s\_\{N\}\\\}, the goal is to return a ranked shortlist ofkkskills that are both relevant to the query and non\-redundant with each other\. Standard top\-kkretrieval addresses only the first requirement: it ranks each skill independently by relevance and overlooks whether the selected skills cover distinct parts of the task\.

Our proposed DSR addresses this limitation by combining query\-dependent quality scores with diversity\-aware subset selection\. It first retrieves a small candidate set, assigns each candidate a quality score, and then applies DPP\-based greedy MAP selection to construct a non\-redundant shortlist\.

We use two types of scoring models\. The first is an encoder retriever, which independently embeds the query and each skill and scores a pair with cosine similarity\. The encoder retriever is used for efficient candidate retrieval from the full registry\. The second is a pointwise quality model, or reranker, which takes a query\-skill pair as input and outputs a relevance logit\. The reranker is more expressive but is applied only to the retrieved candidate set for efficiency\. In our main experiments, DSR uses reranker scores as the quality signal; we later ablate this choice by replacing reranker quality with embedding\-based quality in Section[4\.3](https://arxiv.org/html/2609.05824#S4.SS3)\.

### 3\.1Candidate Skill Retrieval

Let𝐞x\\mathbf\{e\}\_\{x\}denote the embedding of queryxxand𝐞i\\mathbf\{e\}\_\{i\}denote the embedding of skillsis\_\{i\}\. All embeddings are L2\-normalized\. We define the retrieval score asai​\(x\)=𝐞x⊤​𝐞ia\_\{i\}\(x\)=\\mathbf\{e\}\_\{x\}^\{\\top\}\\mathbf\{e\}\_\{i\}and retrieve theMMhighest\-scoring skills:

𝒞x=arg⁡max⁡∑si∈𝒞𝒞⊆𝒮,\|𝒞\|=M⁡ai​\(x\),\\mathcal\{C\}\_\{x\}=\\arg\\max\_\{\\mathcal\{C\}\\subseteq\\mathcal\{S\},\|\\mathcal\{C\}\|=M\}\\sum\_\{s\_\{i\}\\in\\mathcal\{C\}\}a\_\{i\}\(x\),\(1\)whereM≪NM\\ll N\. DSR applies diversity\-aware selection only within𝒞x\\mathcal\{C\}\_\{x\}, which makes reranking tractable for large skill registries\.

### 3\.2Quality\-Aware DPP Selection

For each candidate skillsi∈𝒞xs\_\{i\}\\in\\mathcal\{C\}\_\{x\}, DSR requires a non\-negative quality scoreqi​\(x\)q\_\{i\}\(x\)that measures its relevance to the query\. In our experiments, this score is provided by the learned pointwise reranker used in SkillRouter\. Lethi​\(x\)h\_\{i\}\(x\)denote the raw reranker logit for queryxxand skillsis\_\{i\}\. We define

qi​\(x\)=σ⁡\(hi​\(x\)\)\.q\_\{i\}\(x\)=\\sigma\(h\_\{i\}\(x\)\)\.\(2\)This transformation maps reranker logits to non\-negative quality scores, which determine the item\-quality terms in the DPP kernel\.

DSR constructs a DPP kernel𝐋\(x\)\\mathbf\{L\}^\{\(x\)\}over𝒞x\\mathcal\{C\}\_\{x\}:

Li​j\(x\)=qi​\(x\)​ϕx​\(si,sj\)​qj​\(x\),L^\{\(x\)\}\_\{ij\}=q\_\{i\}\(x\)\\,\\phi\_\{x\}\(s\_\{i\},s\_\{j\}\)\\,q\_\{j\}\(x\),\(3\)whereϕx​\(si,sj\)\\phi\_\{x\}\(s\_\{i\},s\_\{j\}\)is a query\-conditioned similarity between skills\. For a subsetA⊆𝒞xA\\subseteq\\mathcal\{C\}\_\{x\}, the DPP score is

F⁡\(A,x\)=det\(𝐋A\(x\)\),F\(A;x\)=\\det\(\\mathbf\{L\}^\{\(x\)\}\_\{A\}\),\(4\)where𝐋A\(x\)\\mathbf\{L\}^\{\(x\)\}\_\{A\}is the principal submatrix indexed byAA\. The determinant favors subsets whose elements have high quality scores while avoiding redundant skill representations\. DSR therefore selects

A⋆=arg⁡max⁡detA⊆𝒞x,\|A\|=k⁡\(𝐋A\(x\)\)\.A^\{\\star\}=\\arg\\max\_\{A\\subseteq\\mathcal\{C\}\_\{x\},\|A\|=k\}\\det\(\\mathbf\{L\}^\{\(x\)\}\_\{A\}\)\.\(5\)Whenk=1k=1, this reduces to ordinary relevance ranking becauseϕx​\(si,si\)=1\\phi\_\{x\}\(s\_\{i\},s\_\{i\}\)=1andLi​i\(x\)=qi​\(x\)2L^\{\(x\)\}\_\{ii\}=q\_\{i\}\(x\)^\{2\}\.

### 3\.3Query\-Residual Diversity Kernel

A standard DPP kernel can computeϕx​\(si,sj\)\\phi\_\{x\}\(s\_\{i\},s\_\{j\}\)directly from inter\-skill cosine similarity\. For skill routing, this can be too aggressive: two skills may be close in embedding space because they are redundant, but they may also be close because both are relevant to the same query\. Penalizing all similarity uniformly may remove useful skills that are jointly needed for a multi\-step task\.

DSR instead measures diversity in a query\-residual space\. Let𝐞x\\mathbf\{e\}\_\{x\}and𝐞i\\mathbf\{e\}\_\{i\}be L2\-normalized query and skill embeddings\. We first remove the query\-aligned component from each skill embedding:

𝐫i=𝐞i−\(𝐞i⊤​𝐞x\)​𝐞x\.\\mathbf\{r\}\_\{i\}=\\mathbf\{e\}\_\{i\}\-\(\\mathbf\{e\}\_\{i\}^\{\\top\}\\mathbf\{e\}\_\{x\}\)\\mathbf\{e\}\_\{x\}\.\(6\)We then blend this residual with the original skill embedding and normalize the result:

𝐳~i=λ​𝐫i\+\(1−λ\)​𝐞i,𝐳i=𝐳~i‖𝐳~i‖2\.\\tilde\{\\mathbf\{z\}\}\_\{i\}=\\lambda\\mathbf\{r\}\_\{i\}\+\(1\-\\lambda\)\\mathbf\{e\}\_\{i\},\\qquad\\mathbf\{z\}\_\{i\}=\\frac\{\\tilde\{\\mathbf\{z\}\}\_\{i\}\}\{\\\|\\tilde\{\\mathbf\{z\}\}\_\{i\}\\\|\_\{2\}\}\.\(7\)whereλ∈\[0,1\]\\lambda\\in\[0,1\]controls the strength of the residual projection\. This mixture focuses the diversity computation on query\-orthogonal variation while retaining a small amount of the original representation for stability\.

The query\-conditioned similarity is

ϕx​\(si,sj\)=1\+𝐳i⊤​𝐳j2\.\\phi\_\{x\}\(s\_\{i\},s\_\{j\}\)=\\frac\{1\+\\mathbf\{z\}\_\{i\}^\{\\top\}\\mathbf\{z\}\_\{j\}\}\{2\}\.\(8\)This maps cosine similarity to\[0,1\]\[0,1\]and ensuresϕx​\(si,si\)=1\\phi\_\{x\}\(s\_\{i\},s\_\{i\}\)=1\. The resulting kernel penalizes residual overlap between skills while reducing penalties caused only by shared relevance to the query\.

#### Why query\-residual diversity?

Raw inter\-skill similarity treats all shared embedding directions as redundancy\. This assumption is too strong for skill routing because skills required by the same query often share a query\-aligned component\. For example, a multi\-step data analysis request may require one skill for parsing a spreadsheet, another for cleaning columns, and another for generating a visualization\. These skills can be close in the original embedding space because they are all relevant to the same request, but selecting them together is still useful because they cover different parts of the workflow\. A standard cosine kernel can over\-penalize such skills and favor candidates that are superficially different but less useful\. The query\-residual kernel removes the shared query direction before computing inter\-skill similarity, so the diversity term focuses on overlap that remains after accounting for relevance to the same request\. This matches the goal of DSR: selected skills should be jointly relevant to the query while still contributing distinct functionality\.

Algorithm 1DSR Inference0:Query

xx, skill pool

𝒮\\mathcal\{S\}, candidate size

MM, output size

kk
1:Encode

xxand skills in

𝒮\\mathcal\{S\}to obtain normalized embeddings

𝐞x\\mathbf\{e\}\_\{x\}and

\{𝐞i\}i=1N\\\{\\mathbf\{e\}\_\{i\}\\\}\_\{i=1\}^\{N\}
2:Retrieve candidate set

𝒞x\\mathcal\{C\}\_\{x\}using Eq\. \([1](https://arxiv.org/html/2609.05824#S3.E1)\)

3:Compute quality scores

qi​\(x\)q\_\{i\}\(x\)for each

si∈𝒞xs\_\{i\}\\in\\mathcal\{C\}\_\{x\}
4:foreach

si∈𝒞xs\_\{i\}\\in\\mathcal\{C\}\_\{x\}do

5:Compute residual representation:

𝐫i←𝐞i−\(𝐞i⊤​𝐞x\)​𝐞x\\mathbf\{r\}\_\{i\}\\leftarrow\\mathbf\{e\}\_\{i\}\-\(\\mathbf\{e\}\_\{i\}^\{\\top\}\\mathbf\{e\}\_\{x\}\)\\mathbf\{e\}\_\{x\}
6:Mix residual and original embedding:

𝐳~i←λ​𝐫i\+\(1−λ\)​𝐞i\\tilde\{\\mathbf\{z\}\}\_\{i\}\\leftarrow\\lambda\\mathbf\{r\}\_\{i\}\+\(1\-\\lambda\)\\mathbf\{e\}\_\{i\}
7:Normalize:

𝐳i←𝐳~i/‖𝐳~i‖2\\mathbf\{z\}\_\{i\}\\leftarrow\\tilde\{\\mathbf\{z\}\}\_\{i\}/\\\|\\tilde\{\\mathbf\{z\}\}\_\{i\}\\\|\_\{2\}
8:endfor

9:Construct

ϕx​\(si,sj\)←\(1\+𝐳i⊤​𝐳j\)/2\\phi\_\{x\}\(s\_\{i\},s\_\{j\}\)\\leftarrow\(1\+\\mathbf\{z\}\_\{i\}^\{\\top\}\\mathbf\{z\}\_\{j\}\)/2
10:Construct DPP kernel

Li​j\(x\)←qi​\(x\)​ϕx​\(si,sj\)​qj​\(x\)L^\{\(x\)\}\_\{ij\}\\leftarrow q\_\{i\}\(x\)\\phi\_\{x\}\(s\_\{i\},s\_\{j\}\)q\_\{j\}\(x\)
11:Initialize

A←∅A\\leftarrow\\emptyset
12:while

\|A\|<k\|A\|<kdo

13:Select

s⋆s^\{\\star\}with the largest log\-determinant marginal gain

14:Update

A←A∪\{s⋆\}A\\leftarrow A\\cup\\\{s^\{\\star\}\\\}
15:endwhile

16:returnSelected skills in

AA, sorted by quality score

### 3\.4Greedy MAP Selection and Ranking

Exact DPP MAP inference is computationally expensive, so DSR uses greedy MAP selection\. Starting from the empty set, it repeatedly adds the candidate with the largest marginal gain:

s⋆=argmaxsi∈𝒞x∖Alogdet\(𝐋A∪\{si\}\(x\)\)−logdet\(𝐋A\(x\)\)\.s^\{\\star\}=\\arg\\max\_\{s\_\{i\}\\in\\mathcal\{C\}\_\{x\}\\setminus A\}\\log\\det\(\\mathbf\{L\}^\{\(x\)\}\_\{A\\cup\\\{s\_\{i\}\\\}\}\)\-\\log\\det\(\\mathbf\{L\}^\{\(x\)\}\_\{A\}\)\.\(9\)The process stops when\|A\|=k\|A\|=k\.

The first greedy step preserves the top prediction from the quality model\. WhenA=∅A=\\emptyset, the marginal gain forsis\_\{i\}is

log⁡Li​i\(x\)=log⁡qi​\(x\)2,\\log L^\{\(x\)\}\_\{ii\}=\\log q\_\{i\}\(x\)^\{2\},\(10\)sinceϕx​\(si,si\)=1\\phi\_\{x\}\(s\_\{i\},s\_\{i\}\)=1\. Thus, the first selected skill is

s\(1\)=arg⁡maxsi∈𝒞x​qi​\(x\)\.s\_\{\(1\)\}=\\arg\\max\_\{s\_\{i\}\\in\\mathcal\{C\}\_\{x\}\}q\_\{i\}\(x\)\.\(11\)Later steps condition on the selected set and favor candidates that add complementary information\. The final selected skills are sorted by quality score to produce the output ranking\.

DSR applies DPP selection only to the retrieved candidate set𝒞x\\mathcal\{C\}\_\{x\}, not the full skill pool\. Greedy MAP is implemented with incremental Cholesky updates, which compute log\-determinant marginal gains without recomputing determinants from scratch\.

Algorithm[1](https://arxiv.org/html/2609.05824#alg1)summarizes the inference procedure\. DSR retrieves candidates, computes reranker quality scores, constructs the query\-residual DPP kernel, and greedily selects a compact skill set before sorting the selected skills by quality\.

## 4Experiments

We evaluate whether diversity\-aware selection improves skill routing over large and redundant skill registries\. Our experiments are designed to answer three questions: \(i\) whether DSR improves coverage of required skills compared with pointwise retrieval and reranking; \(ii\) whether the gains are larger for multi\-skill queries; and \(iii\) whether the query\-residual kernel is necessary for effective diversity\-aware selection\.

### 4\.1Experimental Setup

#### Benchmark\.

We evaluate on the SkillRouter benchmark introduced by[Zheng et al\. \(2026\)](https://arxiv.org/html/2609.05824#bib.bib6), which studies skill selection over a large registry derived from the Claude Skill Registry\. The benchmark contains 75 expert\-verified queries over approximately 80K candidate skills\. These queries span 55 domains across 8 super\-categories and include both single\-skill and multi\-skill tasks\. The single\-skill subset contains 24 queries that require one target skill, while the multi\-skill subset contains 51 queries that require two to five target skills\. Following the benchmark protocol, we evaluate on two robustness tiers:Easy, with 78,361 candidate skills, andHard, with 79,141 candidate skills including 780 LLM\-generated distractor skills\. We report averages across both tiers unless otherwise specified\.

#### Baseline\.

We compare against the full SkillRouter pipeline\([Zheng et al\., 2026](https://arxiv.org/html/2609.05824#bib.bib6)\)\. SkillRouter follows a retrieve\-and\-rerank design: SR\-Emb\-0\.6B first retrieves candidate skills from the full registry, and SR\-Rank\-0\.6B then reranks the retrieved candidates using the full skill text\. This provides a strong pointwise reranking baseline because each candidate skill is evaluated with a learned relevance model rather than only embedding similarity\. However, the final ranking is still produced independently for each skill: the score of one skill does not depend on which other skills are also selected\. As a result, SkillRouter can assign high ranks to multiple overlapping skills when they are all individually relevant to the query\.

#### DSR variant\.

DSR uses the same SR\-Emb\-0\.6B retriever and SR\-Rank\-0\.6B relevance model as SkillRouter\. The only change is the final selection step: instead of returning the pointwise top\-ranked skills, DSR constructs a query\-residual DPP kernel over the retrieved candidates and selects a shortlist that balances relevance and non\-redundancy\. This design keeps candidate generation and relevance scoring fixed, allowing us to isolate the effect of diversity\-aware selection\. In other words, DSR does not rely on a stronger retriever or a stronger reranker; it changes how high\-scoring candidates are selected together\.

#### Implementation details\.

For DSR, we retrieve the top 50 candidates before applying DPP selection\. The query\-residual kernel uses residual mixing coefficientλ=0\.85\\lambda=0\.85\. Greedy MAP selection is implemented with incremental Cholesky updates\. We evaluate ranked outputs at cutoffsk∈\{10,20,50\}k\\in\\\{10,20,50\\\}\. Since the released SkillRouter pipeline returns 20 ranked skills, its Recall@50 and Full Coverage@50 are equal to its Recall@20 and Full Coverage@20\. We report these values for completeness, and focus the main comparison on shared cutoffs as well as the coverage behavior of longer DSR shortlists\. All experiments were conducted on NVIDIA A100 80GB GPUs\.

Table 1:Full\-pipeline results on the SkillRouter benchmark\. Both methods use SR\-Emb\-0\.6B retrieval and SR\-Rank\-0\.6B relevance scores\. SkillRouter applies pointwise reranking, while DSR applies query\-residual DPP selection\. For SkillRouter, Recall@50 and Full Coverage@50 equal the corresponding @20 values because its released output is truncated at 20\. Bold indicates the best result in each column\.
#### Metrics\.

We use two primary coverage metrics\.Recall@kmeasures the fraction of target skills recovered in the topkkpredictions\.Full Coverage@kmeasures whether all target skills for a query are retrieved within the topkkpositions\. Full Coverage is stricter than recall and is especially important for multi\-skill tasks, where missing any required skill may prevent the agent from completing the workflow\. Since our focus is complementary skill\-set recovery, we report MRR@k only in the appendix[A](https://arxiv.org/html/2609.05824#A1)as an early\-precision diagnostic\.

### 4\.2Main Results

Table[1](https://arxiv.org/html/2609.05824#S4.T1)compares DSR with the full SkillRouter pipeline under the controlled setup described above\. DSR improves coverage\-oriented metrics across all evaluated cutoffs\. On all queries, Recall@20 increases from0\.7540\.754to0\.7680\.768, and Full Coverage@20 increases from0\.5600\.560to0\.5730\.573\. These gains are modest at the shared cutoff, but they show that DSR can recover more target skills without changing the underlying relevance model\. Appendix[A](https://arxiv.org/html/2609.05824#A1)further shows that DSR remains close to SkillRouter on MRR, indicating that the coverage gains do not come from a large loss in early precision\.

The benefit becomes clearer for longer shortlists\. At cutoff 50, DSR improves overall Recall from0\.7540\.754to0\.8080\.808and Full Coverage from0\.5600\.560to0\.6330\.633\. This pattern is expected: pointwise reranking can place several similar skills near the top, while DSR encourages the selected shortlist to cover different parts of the task\. Since the released SkillRouter output contains 20 ranked skills, its Recall@50 and Full Coverage@50 are equal to its @20 values\. We therefore treat @20 as the shared\-cutoff comparison and use @50 to examine whether diversity\-aware selection can construct a longer, less redundant shortlist\.

DSR is especially useful for multi\-skill queries\. On this subset, Recall@20 improves from0\.7040\.704to0\.7390\.739, and Full Coverage@20 improves from0\.4580\.458to0\.4920\.492\. At cutoff 50, Recall improves from0\.7040\.704to0\.7730\.773, while Full Coverage improves from0\.4580\.458to0\.5510\.551\. These results support our main hypothesis: skill routing should not only rank individually relevant skills, but also select non\-redundant skill sets that better cover the requirements of complex tasks\.

### 4\.3Ablation Study

Table[2](https://arxiv.org/html/2609.05824#S4.T2)analyzes two design choices in DSR: the diversity kernel and the quality score\. The diversity kernel determines how redundancy between two candidate skills is measured\. The standard cosine kernel computes similarity directly from skill embeddings, while the query\-residual kernel first removes the query\-aligned component and then measures similarity in the residual space\. The quality score determines how strongly each individual skill is favored before diversity is considered\. Our main method uses reranker quality from SR\-Rank\-0\.6B\. To test whether the quality source matters, we also include an ablation that replaces reranker quality with embedding quality, whereqi​\(x\)q\_\{i\}\(x\)is computed from normalized query\-skill embedding similarity\.

The query\-residual kernel accounts for the largest ablation effect\. With reranker quality, replacing the standard cosine kernel with the query\-residual kernel improves multi\-skill Full Coverage@10 from0\.2540\.254to0\.4410\.441\. This result shows that naive diversity is not sufficient for skill routing\. A raw cosine kernel penalizes all inter\-skill similarity, including similarity that arises because two skills are both relevant to the same query\. In multi\-skill tasks, this can remove useful complementary skills that share the same task context but contribute different functionality\. The residual kernel avoids this failure mode by focusing the diversity penalty on overlap beyond the query direction\.

The quality signal also matters\. With the query\-residual kernel, replacing embedding quality with reranker quality improves Recall@10 from0\.6180\.618to0\.7110\.711and multi\-skill Full Coverage@10 from0\.2370\.237to0\.4410\.441\. This indicates that diversity\-aware selection still depends on a reliable relevance signal: if the quality scores do not identify useful candidates, the DPP has less useful material to select from\. At the same time, comparing SkillRouter with the residual\-kernel DSR variants shows that reranker quality alone is not enough\. The strongest coverage\-oriented results come from combining a learned relevance model with query\-residual diversity\.

Table 2:Ablation study of DSR design choices\. All DSR variants use SR\-Emb\-0\.6B retrieval over the top 50 candidates\. Embedding quality uses normalized query\-skill embedding similarity asqi​\(x\)q\_\{i\}\(x\), while reranker quality uses SR\-Rank\-0\.6B scores\. R@10 is averaged over all queries; Multi\-FC@10 is Full Coverage@10 on multi\-skill queries\.
### 4\.4Analysis of Reranking Strategies

Table[3](https://arxiv.org/html/2609.05824#S4.T3)compares different ranking and selection strategies on single\-skill and multi\-skill queries\. The compared methods represent increasingly expressive ways to order the retrieved candidates: embedding\-only Top\-kkretrieval, zero\-shot LLM reranking, the learned SkillRouter reranker, and DSR\.

On single\-skill queries, Top\-kkretrieval, SkillRouter, and DSR achieve the same Recall@10 and Full Coverage@10\. This suggests that when only one target skill is required, strong pointwise relevance signals are often sufficient\. The main challenge appears in the multi\-skill setting, where the router must recover several required skills within the same shortlist\.

Compared with Top\-kkretrieval, SkillRouter improves multi\-skill Recall@10 from0\.6300\.630to0\.6590\.659and Full Coverage@10 from0\.3810\.381to0\.4240\.424, showing the value of a learned reranker\. DSR further improves Recall@10 to0\.6680\.668and Full Coverage@10 to0\.4320\.432\. These gains are smaller than those at larger cutoffs in Table[1](https://arxiv.org/html/2609.05824#S4.T1), but they follow the same pattern: diversity\-aware selection helps most when the task requires multiple complementary skills\. The zero\-shot LLM ranker performs worse than SkillRouter and DSR, suggesting that prompt\-based reranking alone is not enough for fine\-grained discrimination among many similar skills\.

Table 3:Comparison of ranking and selection strategies for single\-skill and multi\-skill queries\. Top\-kkretrieval ranks skills by embedding similarity without reranking\. The LLM ranker uses Qwen3\-8B in a zero\-shot reranking setting\. SkillRouter uses the learned SR\-Rank\-0\.6B pointwise reranker\. DSR applies diversity\-aware selection using reranker quality and the query\-residual kernel\.#### Overall takeaways\.

Across the main comparison, ablation study, and reranking\-strategy analysis, the same pattern emerges\. Pointwise relevance models are effective for identifying individually useful skills, especially when a query requires only one target skill\. However, they do not directly optimize coverage of a required skill set\. DSR improves this coverage by changing the selection objective rather than the underlying retriever or reranker\. The largest gains appear for multi\-skill queries and larger cutoffs, which is consistent with the role of diversity\-aware selection: it mainly improves which additional skills are included after the highest\-scoring candidates have already been found\.

The results also clarify when diversity should be applied\. The ablation shows that diversity based on raw inter\-skill cosine similarity can hurt coverage, even when the same quality scores are used\. This suggests that diversity is useful only when the similarity measure reflects redundancy rather than shared relevance\. The query\-residual kernel provides this distinction by removing the query\-aligned component before measuring inter\-skill overlap\. As a result, DSR encourages the selected skills to remain close to the user request while reducing overlap among the selected candidates\.

This distinction is important for skill routing because multi\-skill queries often require several skills that are related to the same task but not interchangeable\. A router that penalizes all similarity may remove useful skills simply because they share the same task context\. Conversely, a router that ignores diversity may return several high\-scoring but overlapping skills\. DSR addresses the middle ground: it keeps the relevance signal from the learned reranker while using query\-conditioned diversity to improve coverage of complementary skills\.

## 5Conclusion

We studied skill routing for LLM agents over large and redundant skill registries\. Existing skill routers typically rank candidate skills independently by query relevance, which can waste context budget on redundant skills and miss complementary skills needed for multi\-step tasks\. To address this limitation, we proposed DSR, a diversity\-aware reranking framework that uses DPP\-based subset selection to balance relevance and non\-redundancy\. DSR introduces a query\-residual diversity kernel that penalizes redundant skill overlap while reducing penalties caused by shared query relevance\.

Experiments on the SkillRouter benchmark show that DSR improves recall and full coverage over a strong pointwise reranking baseline, with larger gains on multi\-skill queries\. Further analysis shows that the query\-residual kernel is critical for effective diversity\-aware selection, and that the benefits of DSR are most clear when the router must recover multiple required skills within a limited shortlist\. These findings show that the selection layer remains important even when the retriever and reranker are fixed\. As skill registries continue to grow, effective agent systems will need routing methods that account not only for individual relevance, but also for redundancy and complementarity among the selected skills\.

## Limitations

Our evaluation follows the SkillRouter benchmark, which contains 75 expert\-verified queries over a large skill registry\. Although the registry is large and includes both single\-skill and multi\-skill tasks, the number of evaluated queries is limited\. Future work should evaluate diversity\-aware skill routing on broader benchmarks with more domains, more complex workflows, and different types of skills\.

DSR operates after candidate retrieval\. If the initial retriever does not include required skills in the candidate set, the DPP selection stage cannot recover them\. Our results therefore isolate the effect of diversity\-aware selection given a retrieved candidate pool, but they do not remove the need for strong skill retrieval and relevance modeling\. Improving candidate generation and diversity\-aware selection jointly could be an important direction for future work\.

We evaluate skill routing using retrieval\-based metrics such as Recall and Full Coverage\. These metrics measure whether the required skills are retrieved, but they do not directly measure downstream agent execution success\. In practice, an agent may still fail even when all required skills are retrieved, for example because of incorrect tool use, poor planning, or conflicts among skill instructions\. Future evaluations should connect skill\-set coverage with end\-to\-end task completion\.

DSR adds a DPP\-based selection step after reranking\. We apply this step only to the retrieved top candidates, which keeps the overhead manageable, but the cost may still matter for latency\-sensitive deployments or much larger candidate sets\. More efficient approximations and adaptive candidate sizes could further reduce the cost of diversity\-aware selection\.

## References

- Affandiet al\.\(2014\)R\. H\. Affandi, E\. Fox, R\. Adams, and B\. TaskarLearning the parameters of determinantal point process kernels\.InInternational Conference on Machine Learning,pp\. 1224–1232\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Carbonell and Goldstein \(1998\)J\. Carbonell and J\. GoldsteinThe use of MMR, diversity\-based reranking for reordering documents and producing summaries\.InProceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval,pp\. 335–336\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Chenet al\.\(2023\)L\. Chen, M\. Zaharia, and J\. ZouFrugalGPT: how to use large language models while reducing cost and improving performance\.arXiv preprint arXiv:2305\.05176\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px3.p1.1)\.
- Chenet al\.\(2024\)S\. Chen, W\. Jiang, B\. Lin, J\. T\. Kwok, and Y\. ZhangRouterDC: query\-based router by dual contrastive learning for assembling large language models\.InAdvances in Neural Information Processing Systems,Vol\.37\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px3.p1.1)\.
- Choet al\.\(2019\)S\. Cho, C\. Li, D\. Yu, H\. Foroosh, and F\. LiuMulti\-document summarization with determinantal point processes and contextualized representations\.InProceedings of the 2nd Workshop on New Frontiers in Summarization,pp\. 98–103\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Denget al\.\(2020\)Q\. Deng, K\. Wang, M\. Zhao, Z\. Zou, R\. Wu, J\. Tao, C\. Fan, and L\. ChenPersonalized bundle recommendation in online games\.InProceedings of the 29th ACM International Conference on Information and Knowledge Management,pp\. 2381–2388\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Hanet al\.\(2017\)I\. Han, P\. Kambadur, K\. Park, and J\. ShinFaster greedy map inference for determinantal point processes\.InInternational Conference on Machine Learning,pp\. 1384–1393\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Huet al\.\(2024\)Q\. J\. Hu, J\. Bieker, X\. Li, N\. Jiang, B\. Keigwin, G\. Ranganath, K\. Keutzer, and S\. K\. UpadhyayRouterBench: a benchmark for multi\-LLM routing system\.arXiv preprint arXiv:2403\.12031\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px3.p1.1)\.
- Huanget al\.\(2025\)Z\. Huang, G\. Ling, Y\. Lin, Y\. Chen, S\. Zhong, H\. Wu, and L\. LinRouterEval: a comprehensive benchmark for routing LLMs to explore model\-level scaling up in LLMs\.InFindings of the Association for Computational Linguistics: EMNLP 2025,pp\. 3860–3887\.Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px3.p1.1)\.
- Kulesza and Taskar \(2012\)A\. Kulesza and B\. TaskarDeterminantal point processes for machine learning\.Foundations and Trends in Machine Learning5\(2–3\),pp\. 123–286\.Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p4.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Liet al\.\(2026\)X\. Li, W\. Chen, Y\. Liu, S\. Zheng, X\. Chen, Y\. He, Y\. Li, B\. You, H\. Shen, J\. Sun, S\. Wang, B\. Li, Q\. Zeng, D\. Wang, X\. Zhao, Y\. Wang, R\. B\. Chaim, Z\. Di, Y\. Gao, J\. He, Y\. He, L\. Jing, L\. Kong, X\. Lan, J\. Li, S\. Li, Y\. Li, Y\. Lin, X\. Liu, X\. Liu, H\. Lyu, Z\. Ma, B\. Wang, R\. Wang, T\. Wang, W\. Ye, Y\. Zhang, H\. Xing, Y\. Xue, S\. Dillmann, and H\. LeeSkillsBench: benchmarking how well agent skills work across diverse tasks\.External Links:2602\.12670,[Link](https://arxiv.org/abs/2602.12670)Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p2.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px2.p1.1)\.
- Onget al\.\(2025\)I\. Ong, A\. Almahairi, V\. Wu, W\. Chiang, T\. Wu, J\. E\. Gonzalez, M\. W\. Kadous, and I\. StoicaRouteLLM: learning to route llms with preference data\.InInternational Conference on Learning Representations,Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px3.p1.1)\.
- Qinet al\.\(2023\)Y\. Qin, S\. Liang, Y\. Ye, K\. Zhu, L\. Yan, Y\. Lu, Y\. Lin, X\. Cong, X\. Tang, B\. Qian, S\. Zhao, L\. Hong, R\. Tian, R\. Xie, J\. Zhou, M\. Gerstein, D\. Li, Z\. Liu, and M\. SunToolLLM: facilitating large language models to master 16000\+ real\-world apis\.External Links:2307\.16789,[Link](https://arxiv.org/abs/2307.16789)Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p1.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px1.p1.1)\.
- Santoset al\.\(2010\)R\. Santos, J\. Peng, C\. Macdonald, and I\. OunisExplicit search result diversification through sub\-queries\.pp\. 87–99\.External Links:ISBN 978\-3\-642\-12274\-3,[Document](https://dx.doi.org/10.1007/978-3-642-12275-0%5F11)Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Schicket al\.\(2023\)T\. Schick, J\. Dwivedi\-Yu, R\. Dessi, R\. Raileanu, M\. Lomeli, E\. Hambro, L\. Zettlemoyer, N\. Cancedda, and T\. ScialomToolformer: language models can teach themselves to use tools\.InThirty\-seventh Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=Yacmpz84TH)Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p1.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px1.p1.1)\.
- Shenet al\.\(2023\)Y\. Shen, K\. Song, X\. Tan, D\. Li, W\. Lu, and Y\. ZhuangHuggingGPT: solving ai tasks with chatgpt and its friends in hugging face\.External Links:2303\.17580,[Link](https://arxiv.org/abs/2303.17580)Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p1.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px1.p1.1)\.
- Wanget al\.\(2023\)G\. Wang, Y\. Xie, Y\. Jiang, A\. Mandlekar, C\. Xiao, Y\. Zhu, L\. Fan, and A\. AnandkumarVoyager: an open\-ended embodied agent with large language models\.External Links:2305\.16291,[Link](https://arxiv.org/abs/2305.16291)Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p1.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px1.p1.1)\.
- Wanget al\.\(2025\)W\. Wang, T\. Yang, H\. Chen, Y\. Zhao, F\. Dernoncourt, R\. A\. Rossi, and H\. EldardiryLearning to route llms from bandit feedback: one policy, many trade\-offs\.External Links:2510\.07429Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px3.p1.1)\.
- Wilhelmet al\.\(2018\)M\. Wilhelm, A\. Ramanathan, A\. Bonomo, S\. Jain, E\. Chi, and J\. GillenwaterPractical diversified recommendations on youtube with determinantal point processes\.pp\. 2165–2173\.External Links:[Document](https://dx.doi.org/10.1145/3269206.3272018)Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px4.p1.1)\.
- Xu and Yan \(2026\)R\. Xu and Y\. YanAgent skills for large language models: architecture, acquisition, security, and the path forward\.External Links:2602\.12430,[Link](https://arxiv.org/abs/2602.12430)Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p1.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px2.p1.1)\.
- Zhenget al\.\(2026\)Y\. Zheng, Z\. Zhang, C\. Ma, Y\. Yu, J\. Zhu, Y\. Wu, T\. Xu, B\. Dong, H\. Zhu, R\. Huang, and G\. YuSkillRouter: skill routing for llm agents at scale\.External Links:2603\.22455,[Link](https://arxiv.org/abs/2603.22455)Cited by:[§1](https://arxiv.org/html/2609.05824#S1.p2.1),[§1](https://arxiv.org/html/2609.05824#S1.p6.1),[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px2.p1.1),[§4\.1](https://arxiv.org/html/2609.05824#S4.SS1.SSS0.Px1.p1.1),[§4\.1](https://arxiv.org/html/2609.05824#S4.SS1.SSS0.Px2.p1.1)\.
- Zhuanget al\.\(2025\)R\. Zhuang, T\. Wu, Z\. Wen, A\. Li, J\. Jiao, and K\. RamchandranEmbedLLM: learning compact representations of large language models\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=Fs9EabmQrJ)Cited by:[§2](https://arxiv.org/html/2609.05824#S2.SS0.SSS0.Px3.p1.1)\.

Table 4:Full\-pipeline results with MRR included as an early\-precision diagnostic\. Both methods use SR\-Emb\-0\.6B retrieval and SR\-Rank\-0\.6B relevance scores\. The main paper focuses on Recall and Full Coverage because multi\-skill routing requires recovering complete skill sets\.## Appendix AMRR Diagnostic

Table[4](https://arxiv.org/html/2609.05824#A0.T4)reports MRR together with the coverage metrics from the full\-pipeline comparison\. MRR measures the rank of the first retrieved correct skill, so it is mainly an early\-precision diagnostic\. This metric is less aligned with our main goal because multi\-skill routing requires recovering the full set of required skills, not only one correct skill\.

DSR remains close to SkillRouter on MRR while improving Recall and Full Coverage\. On all queries, DSR obtains MRR@10 of0\.7840\.784, compared with0\.7880\.788for SkillRouter\. On multi\-skill queries, DSR obtains MRR@10 of0\.7880\.788, compared with0\.7920\.792for SkillRouter\. These small differences suggest that DSR improves skill\-set coverage without substantially degrading the first relevant skill position\.

## Appendix BLLM Usage

We used ChatGPT during the preparation of this manuscript for language editing and drafting support\. LLMs were not used to generate experimental results or to make final scientific decisions\.

Similar Articles

SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents

arXiv cs.AI

This paper introduces SkillRet, a large-scale benchmark for evaluating skill retrieval in LLM agents, addressing the challenge of selecting relevant skills from large libraries. It provides a dataset of over 17,000 skills and demonstrates that task-specific fine-tuning significantly improves retrieval performance.

Reasoning or Memorization? Direction-Aware Diversity Exploration in LLM Reinforcement Learning

arXiv cs.AI

This paper introduces DiRL, a direction-aware reinforcement learning framework that distinguishes reasoning-driven diversity from memorization-driven diversity in LLM exploration. It extracts an internal reasoning-memorization direction from model representations and shapes rewards to prioritize reasoning-aligned exploration, showing improvements on math and general reasoning benchmarks.