@levie: Agents already make up the majority of inference. This will quickly trend toward nearly all inference over the next yea…

X AI KOLs Following News
ai-agents inference-traffic multi-turn-ai long-context kv-cache-reuse ai-workflows token-consumption

Summary

The tweet asserts that AI agents now dominate inference traffic, with this trend expected to accelerate, leading to agents performing numerous tasks 24/7 and consuming vast amounts of tokens.

Agents already make up the majority of inference. This will quickly trend toward nearly all inference over the next year or two. The vast majority of tokens used in the world will be agents that are executing unbelievable amounts of tasks for us in the background 24/7. Agents will be deployed to read all code changes to secure our software, process all of our data inside of workflows, handle a significant majority of the research that goes into recruiting and customer prospecting, review every event stream and log from every system in the world, go out and execute tasks for us in our personal lives, and hundreds of other use cases. The rate of new agents coming online that will be consuming insane amounts of tokens is not slowing down. Just in the past week I’ve introduced multiple completely new workflows that would not have been possible technically even a month ago. Incredible time to be doing anything in inference and of course building on top of all of this.
Original Article
View Cached Full Text

Cached at: 09/18/26, 06:31 AM

Agents already make up the majority of inference. This will quickly trend toward nearly all inference over the next year or two.

The vast majority of tokens used in the world will be agents that are executing unbelievable amounts of tasks for us in the background 24/7.

Agents will be deployed to read all code changes to secure our software, process all of our data inside of workflows, handle a significant majority of the research that goes into recruiting and customer prospecting, review every event stream and log from every system in the world, go out and execute tasks for us in our personal lives, and hundreds of other use cases.

The rate of new agents coming online that will be consuming insane amounts of tokens is not slowing down. Just in the past week I’ve introduced multiple completely new workflows that would not have been possible technically even a month ago.

Incredible time to be doing anything in inference and of course building on top of all of this.

SemiAnalysis (@SemiAnalysis_): AGENTIC TRAFFIC NOW MAKES UP MORE THAN 70% OF ALL INFERENCE TRAFFIC 🚀

Agentic workloads are characterized by four elements:

🟠 Multi-turn: a session includes tens or hundreds of turns, leading to high potential KV-cache reuse.

🟠 Long context: system prompts, tool

Similar Articles