@rohanpaul_ai: Agents are consuming tokens at nearly 5x the human rate, while their usage has exploded ~14X since February. Once agent…

Agents are consuming tokens at nearly 5x the human rate, while their usage has exploded ~14X since February.

Once agents became the majority of tokens on OpenRouter, the router’s ability to play suppliers off each other may be much less.

OpenRouter sits between developers and the companies that run the models. It makes money by price shopping, sending each query to the cheapest provider at the time.

When the next question is a single question, this is fine; there is no need for any continuity between the questions.

But, the behavior of an agent doing a long task is different: it resends the same long block of background instructions at each stage (i.e. cache hit).

A cache hit only lives on the machine still holding the warm prefix, and rerouting mid-task will mean paying the full pre-fill over again.

i.e. the model provider stores that cache-hit block in memory and charges only a small fraction to reuse it.

Which is why more than 85% of agent tokens on OpenRouter are these cheap reuses (cached prompt) rather than fresh ones.

The copy is stored on the servers of a single company . If the job is transferred to a cheaper competitor halfway through , the stored copy is discarded and the full block is repaid .

That will mean the agent remains with the provider they started the task with until the task is finished and the threat from the router to take their business elsewhere is eliminated.

So looks like the discounts routers can squeeze out of model providers many shrink on agent traffic well before they shrink anywhere else.

a16z (@a16z): Humans are the minority user of AI

Agents burn nearly 5x the tokens people do, up 14x since February

Charts of the Week: