TokenPilot: Cache-Efficient Context Management for LLM Agents

Hugging Face Daily Papers Papers

Summary

TokenPilot is a dual-granularity context management framework that reduces inference costs in long-horizon LLM sessions by stabilizing prompt prefixes and conservatively managing context segments, achieving 61-87% cost reduction on benchmarks while maintaining competitive performance.

As LLM agents are deployed in long-horizon sessions, context accumulation drives up inference costs. Existing approaches utilize text pruning or dynamic memory eviction to minimize token footprints; however, their unconstrained sequence mutations alter layouts, introducing prefix mismatches and cache invalidation. This reveals a critical trade-off between text sparsity and prompt cache continuity. To address this, we present TokenPilot, a dual-granularity context management framework. Globally, Ingestion-Aware Compaction acts as a framework harness to stabilize prompt prefixes and eliminate open-world environmental noise at the ingestion gate. Locally, Lifecycle-Aware Eviction monitors the ongoing residual utility of context segments, enforcing a conservative batch-turn schedule to offload content segments only when task relevance expires. Experiments on PinchBench and Claw-Eval under both isolated and continuous modes demonstrate that TokenPilot reduces costs by 61% and 56% in isolated mode, and 61% and 87% in continuous mode, while maintaining competitive performance compared to prior systems. TokenPilot has been integrated into LightMem2 at https://github.com/zjunlp/LightMem2.
Original Article
View Cached Full Text

Cached at: 06/16/26, 11:34 AM

Paper page - TokenPilot: Cache-Efficient Context Management for LLM Agents

Source: https://huggingface.co/papers/2606.17016 Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

TokenPilot is a dual-granularity context management framework that reduces inference costs in long-horizon LLM sessions by stabilizing prompt prefixes and conservatively managing context segments.

AsLLM agentsare deployed in long-horizon sessions, context accumulation drives up inference costs. Existing approaches utilize text pruning or dynamic memory eviction to minimizetoken footprints; however, their unconstrained sequence mutations alter layouts, introducing prefix mismatches and cache invalidation. This reveals a critical trade-off between text sparsity andprompt cache continuity. To address this, we present TokenPilot, a dual-granularitycontext managementframework. Globally,Ingestion-Aware Compactionacts as a framework harness to stabilize prompt prefixes and eliminate open-world environmental noise at the ingestion gate. Locally,Lifecycle-Aware Evictionmonitors the ongoingresidual utilityof context segments, enforcing a conservativebatch-turn scheduleto offload content segments only when task relevance expires. Experiments on PinchBench and Claw-Eval under both isolated andcontinuous modes demonstrate that TokenPilot reduces costs by 61% and 56% inisolated mode, and 61% and 87% incontinuous mode, while maintaining competitive performance compared to prior systems. TokenPilot has been integrated into LightMem2 at https://github.com/zjunlp/LightMem2.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2606\.17016

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2606.17016 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2606.17016 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2606.17016 in a Space README.md to link it from this page.

Collections including this paper1

Similar Articles

@omarsar0: // The Efficiency Frontier // Cool paper on context management. As agents reuse the same documents and histories across…

X AI KOLs Following

This paper introduces The Efficiency Frontier, a unified framework for cost–performance optimization in LLM context management that models context strategy selection as a deployment-aware optimization problem, achieving 25% reduction in token usage and over 50% lower token cost with amortized memory compression compared to full-context prompting.