Tag
Ramp is open-sourcing its internal LLM router that automatically selects the best model for each request to optimize cost and performance.
TinyRouter is a tiny 10K-parameter LLM router that learns to route each question to the best specialist model from a pool of open-source LLMs, using evolutionary training. It achieves performance matching or exceeding individual models on MMLU and math benchmarks.
The article introduces iii, an open-source platform for building production-ready agentic backends using composable workers that replace traditional service integration, offering a React-like paradigm for backend engineering.
LEMoE is an open-source, stateless Mixture of Experts (MoE) router that acts as an API proxy to route prompts to specialized LLMs, featuring cascading contextual routing and silent self-correction.
FlyRoute is a self-evolving profiling framework that improves LLM-based task routing in multi-agent systems by dynamically updating agent capability descriptions from real traffic, achieving significant accuracy gains over static profiles.