IQ Routing
Summary
IQ Routing is a trajectory-aware LLM routing system designed to reduce the cost of AI agents by optimizing task routing based on trajectory data.
Similar Articles
Learning Agent Routing From Early Experience
This paper introduces BoundaryRouter, a training-free framework that optimizes LLM agent usage by routing queries to either lightweight inference or full agent execution based on early experience. It also presents RouteBench, a benchmark for evaluating routing performance, showing significant improvements in speed and accuracy.
Latency-Quality Routing for Functionally Equivalent Tools in LLM Agents
This paper introduces LQM-ContextRoute, a contextual bandit router for selecting between functionally equivalent tool providers in LLM agents, balancing latency and answer quality. It outperforms baselines on web-search and retriever benchmarks.
Ramp Router claims to cut AI costs by up to 30%
Ramp is open-sourcing its internal LLM router that automatically selects the best model for each request to optimize cost and performance.
Routing agent work across 4 LLM tiers: orchestrator, advisor, deep reasoning, premier
The author shares a practical 4-tier LLM routing stack for agent work, where a fast orchestrator handles most requests and only escalates to expensive models when deep reasoning is required, significantly improving cost and interactivity.
INAR-VL: Input-Aware Routing for Edge-Cloud Vision-Language Inference
INAR-VL proposes a lightweight routing system for edge-cloud vision-language inference that dynamically selects between edge and cloud models based on query complexity, achieving significant latency and energy reductions while preserving near-cloud accuracy.