Can a coding agent use 57–85% less fresh model traffic without losing task success? I open-sourced my experiment

Reddit r/AI_Agents Tools

Summary

The author open-sources an execution and context layer for coding agents that cuts fresh model traffic by 57-85% while preserving task success in paired smoke tests on GPT-5.6 and Claude Opus 5, and seeks independent evaluation and sponsorship.

I built an open-source execution and context layer for coding agents that moves deterministic repository work outside the model loop, supplies bounded task-relevant context, and independently verifies the resulting patch. So far I have three paired smoke tests on one public reset-token fixture: • GPT-5.6 Luna: 85.64% less fresh input + output and 77.87% lower end-to-end time; 4/4 tests in both arms and a byte-identical patch. • GPT-5.6 Sol: 57.75% less fresh input + output and 51.65% lower end-to-end time; 4/4 in both arms, with matching executable changes. • Claude Opus 5, reproduced by a community operator on another machine: 81.44% less fresh input + output, 82.77% lower provider-reported cost, and 70.83% lower end-to-end time; both pristine verification commands passed. These are three single-task pairs, not independent population-level validation, and I do not claim the percentages generalize. I published the sanitized measurements, limitations, and reproducible drivers. The next useful step is a larger evaluator-selected task set, but I no longer have the budget for provider calls and continued integration work. I am looking for independent evaluators, contributors, compute credits, or sponsorship. I will put the repository and evidence link in a comment to follow this community’s rules. What would you want controlled before treating this as credible evidence: more repositories, randomized task selection, repeated pairs, or something else?
Original Article

Similar Articles

Same AI model. Better results. Lower cost.

Reddit r/AI_Agents

The author argues that AI coding harnesses and model routing are as important as the model itself, sharing tests with Oh-My-Pi and OpenCode that cut token usage and errors, and recommending tiered model subscriptions for high-volume lightweight tasks.

Same model, same prompt, two agent harnesses: 45/50 vs 43/50

Reddit r/AI_Agents

The article benchmarks two open-source coding agents on the same deepseek-v4-flash model, finding similar task success rates but significant differences in performance metrics and a critical bug in one agent's error handling.