We split one agent between a cloud planner and a local coder. Here's what it cost:

Reddit r/AI_Agents News

Summary

An experiment compared using a cloud planner with a local coder versus standalone models for AI agent tasks, showing that the planner-worker setup cut costs by 2.7x but increased time and reduced success rates.

Everyone draws the same diagram, a smart model plans and cheap models do the work. We wanted to see what that actually looks like on a real build, so we ran one task three ways. The task was five small physics scenes on one page, one fixed camera, one-line prompt, one autonomous run each, no human fixes. Sonnet 5.5 alone: 4/5 scenes, 9 min, $1.83 Sonnet 5.5 plans, local Qwen 3.8 27B writes the code: 2/5 scenes, 85 min, $0.67 Qwen 3.8 27B alone on an RTX 3090: 1/5 scenes, 26 min, $0 What worked. The planner never touched the code. It split the job into parts, agreed on names between them so they'd fit together, and sent each part a short brief. That's why the bill dropped 2.7x, it wrote 5.4K output tokens instead of 37.9K. What didn't. The local model is the bottleneck. It's slower, so the run took 85 minutes, and it still got fewer scenes right than the cloud model on its own. And every setup reported "done, no errors" while some scenes were visibly broken, so "the agent says it's finished" is still not a reliable signal. Curious how others handle this. If you run a planner/worker setup, how do you check that the workers actually got it right? (We build the agent we used for this, Atomic Agent, open source. Link in the comments if anyone wants it.)
Original Article

Similar Articles