@wquguru: Launched in April 2023, new-api has been operating for over three years, supporting hundreds to thousands of relay instances of all sizes and capturing over 90% of the market. Yet its core developers, @Ion_Mio_ and @Seefs_, remain largely unsung. This article attempts to explore the core algorithms behind new-api and another...
Summary
This article covers the development of the open-source AI model routing tool new-api since its April 2023 release, highlighting its dominance with over 90% market share among relay instances, and delves into both the contributions of its core developers and its underlying routing algorithms.
View Cached Full Text
Cached at: 05/12/26, 10:55 AM
Since April 2023, new-api has been around for over three years, powering hundreds to thousands of relay nodes of all sizes. Over 90% of the market currently relies on this system. Meanwhile, the core developers behind new-api, @Ion_Mio_ and @Seefs_, have quietly contributed without seeking the spotlight. This article attempts to delve into the core algorithms of new-api and another model router.
Similar Articles
@GitHub_Daily: An open-source tool called 9router recently went viral, adding an intelligent dispatch center to all AI coding tools. Usually, when using Claude Code, API quotas deplete rapidly, and encountering lengthy error logs instantly burns through tokens. But 9router has built-in smart compression...
9router is an open-source intelligent routing hub for AI coding tools, featuring built-in compression algorithms to save tokens, supporting a three-tier fallback to automatically switch models, natively compatible with mainstream tools like Claude Code and Cursor, and capable of routing to dozens of model providers, effectively reducing API call costs.
@IndieDevHailey: The Most Powerful Open-Source AI Gateway: OmniRoute – One Local Endpoint, 236 AI Models Covered. A free open-source AI gateway that unifies 236 providers (90+ free, 11 permanently free) into an OpenAI-compatible interface. Self-host locally, deploy in 3 minutes. - Never Downtime: automatic fallback...
OmniRoute is a free and open-source AI gateway that unifies 236 AI provider APIs into a single OpenAI-compatible interface, supporting self-hosting, automatic fallback, intelligent routing, and token compression.
@rwayne: After chatting with someone in the know today, I learned that the relay station has a 100% compliant solution. Wow, the impossible triangle is now possible...
A tweet from @rwayne reports that a relay station (中转站) now has a 100% compliant solution, breaking the 'impossible triangle' in AI API services.
@seclink: I spotted a hot new side-hustle on Xianyu: AI relay stations—demand far outstrips supply… Built with vibe-coding, an OpenAI-compatible relay is low-tech, cheap to run, and customers are queuing up… Wild-west phase = plenty of room for sharp indie devs to cash in.
A booming micro-business on Xianyu: devs use vibe-coding to spin up OpenAI-compatible relay APIs. Low barrier, tiny cost, huge demand—prime time for nimble indie developers to profit.
@GitTrend0x: AI gateway at its peak! One endpoint connects 268+ providers, 500+ models, directly usable with Cursor/Claude Code. Most annoying issues when using AI coding: • Too many models, switching is a hassle • Free credits scattered, often hitting limits • Token consumption too high, costs…
OmniRoute is a free, open-source AI gateway that unifies access to 268+ providers and 500+ models through a single local endpoint, featuring smart routing, token compression, and free tier aggregation to reduce costs and complexity for developers.