@alex_prompter: This open-source proxy cuts your AI agent costs without changing a line of code. Plano sits between your agent and your…
Summary
Plano is an open-source proxy that sits between AI agents and LLM providers to cut costs through intelligent routing, guardrail filtering, and cost-aware selection, all configured via a single YAML file without modifying agent code.
View Cached Full Text
Cached at: 07/12/26, 12:55 PM
This open-source proxy cuts your AI agent costs without changing a line of code.
Plano sits between your agent and your LLM providers. Every request passes through it. Your agent doesn’t know it’s there.
It handles four things. Guardrail filtering before requests hit the model. Smart routing that matches each prompt to the right model by difficulty. Cost-aware selection when multiple models qualify. And model affinity that pins the winner to the session so your prompt cache stays warm.
All of it runs from one YAML config file. Swap a model, change a preference, add a guardrail. Nothing touches your agent code.
The routing runs on Arch-Router, a 1.5B model trained on what developers actually choose for each task type. So routing reflects real-world preferences, not benchmark rankings.
It also ships with an observability console showing which model answered each request and what it cost. If you’ve ever wondered where your API budget goes, that alone is worth setting up.
6.7k stars. Supports OpenAI, Anthropic, Gemini, Mistral, and more.
Similar Articles
@tonysimons_: A Netflix engineer built an open-source proxy that cuts AI token usage by 60-95%. Zero code changes. Benchmarks show ±0…
A Netflix engineer built Headroom, an open-source proxy that compresses LLM context by 60-95% with no code changes and negligible accuracy loss. It supports major AI agents and is available on GitHub under Apache 2.0.
@_avichawla: A tricky LLM interview question: Your agent runs everything on a frontier LLM, so you add a routing layer that sends se…
Explains why model routing in agent tasks may not save costs due to cache warmup, and describes a production solution with model affinity and the open-source proxy Plano to achieve actual savings.
Proxy for LLMs to learn how Agents works?
User seeks an open-source proxy to intercept and debug API calls from AI agents to understand their internal workings, after finding LiteLLM too enterprise-focused.
OpenSquilla launches open-source AI agent to cut token costs (4 minute read)
OpenSquilla has launched an open-source AI agent runtime designed to reduce token costs through intelligent routing, caching, and a four-tier memory architecture, claiming 60-80% cost savings.
I built a proxy to shrink agent LLM requests after my API bill stopped making sense
A solo founder introduces Orqen, a proxy that sits between your SDK and LLM providers to optimize outbound requests by compressing tool results, managing history, and reducing token costs, without changing agent code.