LLMRouter open-sources 16+ router library with xRouteBench

Reddit r/ArtificialInteligence Papers

Summary

A new paper on arXiv introduces an open-source library called LLMRouter with over 16 router implementations and a benchmark xRouteBench, demonstrating that learned routers can outperform fixed-model baselines by 14.6%.

Choosing which model to run on which query has quietly become one of the biggest cost levers in production LLM stacks, and until now there was no common yardstick for comparing the routers that make that choice. A new paper on [arXiv](https://arxiv.org/abs/2608.06867) from Tao Feng and collaborators tries to fix that with two pieces at once: an open-source library called LLMRouter that packages more than 16 router implementations behind one interface, and a benchmark called xRouteBench that spans generic LLM, memory-augmented, vision, time-series, and personalized routing tasks. The headline number is that learned routers beat the strongest fixed-model baseline by 14.6% relatively. That is the kind of margin worth chasing if you are running real inference volume, and the more interesting supporting claims are that lightweight routers stay competitive when cost budgets tighten, and that conditioning the router on the user, not just the query, helps on personalized workloads. The framing itself matters. The authors treat routing as a sequential decision process with five moving parts, context encoders, model encoders, scoring functions, decision rules, and learning signals, which is more architectural than the ad-hoc router papers that came before it. If that framing sticks, comparing router A to router B stops being a marketing exercise and starts being an engineering measurement. The abstract is thin on the specifics a buyer would actually want. It does not name which fixed-model baseline the 14.6% was measured against, does not break out cost or latency, and does not say which router type wins which task inside xRouteBench. Anyone about to standardize on a routing vendor should ask them for their own xRouteBench run first. The bigger deal is that a shared library and a public benchmark now exist together. Router vendors have been shipping savings claims without a leaderboard behind them, and that gets harder from here.
Original Article

Similar Articles

llm-openrouter 0.7

Simon Willison's Blog

Release of llm-openrouter version 0.7, updating compatibility with LLM 0.32 and adding new server-side tools like Shell, WebFetch, and WebSearch for improved use with reasoning LLMs via OpenRouter.

Arch-Router: Aligning LLM Routing with Human Preferences

Papers with Code Trending

Arch-Router is a compact 1.5B model that aligns LLM routing with human preferences by mapping queries to user-defined domains and action types, outperforming proprietary models in subjective evaluations.