Tag
A discussion on how harness designs can reduce token costs by structuring information instead of feeding everything into a language model's context, citing an example of an RLM agent processing many lines of logs with few active tokens.
A GitHub tool that reduces Claude API costs by dynamically adjusting effort/thinking parameters based on prompt complexity.
This paper proposes a unified framework called Efficiency Frontier, which treats large model context management as a deployment optimization problem, jointly modeling task performance, token overhead, and preprocessing reuse. On 5,000 HotpotQA instances, deployment optimization saves 25% of token usage, while memory compression is more than half the cost of full context in high-precision scenarios.
A practical guide explaining how prompt caching works in Claude Code, how it reduces token costs by 90%, and common habits that break the cache, helping developers extend session length and reduce costs.
OpenSquilla has launched an open-source AI agent runtime designed to reduce token costs through intelligent routing, caching, and a four-tier memory architecture, claiming 60-80% cost savings.