What a week of AI agent runs actually cost us: 61 runs, 15.4M tokens, $37.68

If you are curious what agents actually cost to run in production, here's our last week, unedited: - 61 runs - 15.4M tokens - $37.68 total spend - 189 tool calls - 27 minutes of sandbox execution - P95 run duration: 3m 17s That's about $0.62 a run, roughly 250K tokens per run. Some things I didn't expect until we had real metering in front of us: I assumed compute would be a meaningful chunk of the bill. It isn't. The entire week of sandbox time added up to 27 minutes, which costs pennies. The token line is effectively the whole bill, and all our cost thinking has quietly turned into token thinking. The most boring decision turned out to be the most important one: we count spend in millionths of a dollar, as integers. When we reconciled a $5 credit purchase against our payment provider's meter, it matched to the exact micro dollar. I don't think that ever happens with float math on money. The rounding drift just hides until it's real cents. We also gave every run a hard budget that kills it at zero. It felt wrong to build something that blocks our own revenue, but a runaway loop is a race between the model and your wallet, and I'd rather lose the run. Usual caveats: one week, one workload, ours. We build tooling in this space and run our own agents on it, so this is dogfood data. An agent chewing through 200 page PDFs will look nothing like this. If you're running agents in production, I'd honestly love to know what a run costs you.