token-inflation

Tag

Cards List
#token-inflation

Not All Tokens Are Equal: Inflation-Aware Routing for Agentic LLM Systems

arXiv cs.CL · 2026-08-17 Cached

This paper introduces InflationAgent, a routing system for agentic LLMs that measures token inflation, predicts task difficulty using CoT Branching Entropy, and optimizes model selection to maximize accuracy per cost, achieving higher accuracy with fewer tokens on benchmarks like GSM8K.

0 favorites 0 likes
← Back to home

Submit Feedback