How I easily cut my input token burn ~90% on long agent runs
Summary
The author shares a practical tip to reduce input token costs by ~90% on long agent runs using prompt caching: placing unchanged text (system prompt, tool definitions, context) at the start of every prompt to leverage cached prefixes from LLM providers.
Similar Articles
Cut my agent’s tokens by 72% (11.9k ➝ 3.3k per task). Here’s exactly what I changed, with numbers
A developer shares a detailed case study on reducing an AI agent's token consumption by 72% through system prompt reduction, tighter retrieval, tool output pruning, and other techniques, with minimal impact on success rate.
How we made an AI agent faster by moving stable context out of the prompt
Describes a technique to improve AI agent speed by moving stable context out of the prompt, reducing token usage and latency.
Stop shortening your prompts. Six agents, 97-99% cache hit rate - and why the standard advice is backwards.
The article argues that with prompt caching, longer, stable prompts can be cheaper than frequently changing short ones, sharing insights from running AI agents with high cache hit rates.
@pallavishekhar_: How to reduce token usage in AI Agents? Let's understand. AI Agents use LLMs to think, plan, and recommend tools. Every…
This thread shares strategies to reduce token usage in AI agents, including prompt caching, context summarization, using smaller models, trimming tool outputs, subagents, RAG, and tight system prompts.
Prompt Caching In Agents
The article explains how prompt caching works in large language model agents, covering KV cache mechanics, prefill and decode phases, and the impact on latency, cost, and agent design.