My agent is too damn expensive! What do you wish you knew about your LLM token burn?

Reddit r/AI_Agents News

Summary

A discussion post about the high costs of running LLM agents, with users sharing frustrations and seeking advice on tracking token spending and improving efficiency.

Pretty much every day I see posts here on Reddit, across various communities, complaining about their LLM costs. I'm seeing: * People are surprised by their bills * Many don't have an easy way to track spending across agents * Others can't pinpoint where they're wasting money Another popular category of questions and posts is about how to make LLMs more efficient, either by switching models or improving workflows. I'm wondering: *What types of things do you wish you knew ahead of time (beyond token and cost tracking) about agent spending?* For example: * Am I spending more than others like me (with similar workloads/activities)? * Why is my spending going up if I haven't changed anything? * What do efficient agent workflows look like and how could I improve? Let me know in the comments.
Original Article

Similar Articles

What Does a Token Cost? A Mixture-of-Agents Measurement of Sufficient Per-Token Compute

arXiv cs.AI

This paper measures the per-token 'sufficient compute' of LLMs using a Mixture-of-Agents panel of fifteen models across Qwen, OLMo, and R1-distilled families, finding a 0.5B agent reproduces 92-95% of reference tokens while the costliest 10% of tokens account for 64-80% of FLOPs. The resulting per-token compute map improves model routing latency from 7.59s to 5.12s and enables speculative drafting with 32.6% fewer draft tokens than fixed-window baselines.