model-routing

Sakana AI releases Fugu Ultra, an orchestration layer that routes subtasks across multiple models via a unified OpenAI-compatible endpoint, matching performance of leading systems.

A detailed blog post explaining the Sakana Fugu technical report, which introduces orchestrator AI models that route tasks to specialized models, achieving collective intelligence.

An analysis of the emerging applied AI layer in enterprises, outlining key components such as building workflow-specific features, intelligent model routing, change management via FDEs, and domain-specific go-to-market strategies. Argues that this layer will create sustainable moats and value despite some critiques.

OrcaRouter is a new AI gateway that intelligently routes prompts to the best model, offering cost savings, guardrails, and full observability with zero token markup and a free tier.

Practical guide on optimizing costs in Microsoft Agent Framework by using a gateway for caching, context compression, and model routing, ensuring each step uses only the necessary intelligence.

A tweet argues that the layer routing between AI models will become increasingly valuable due to cost optimization, capability differences, and risk mitigation, while quoting OpenRouter's Fusion API announcement.

The tweet criticizes AI apps for overusing large models and introduces Dari Router, a tool designed to route requests to appropriate model sizes for efficiency.

OpenSquilla is an open-source project that enables self-organizing skill orchestration for agents via MetaSkill 3.0, combined with intelligent routing to reduce token costs. The author integrated it into WeSight, demonstrating how a single sentence can convert a WeChat public account article into a Xiaohongshu post, showcasing the potential for agents to self-assemble workflows.

The article describes how building an intelligent caching gateway (Hawiyat Composer) saved significant AI API costs by eliminating repeated token waste through exact-match caching, semantic caching, model routing, and local routing.

Discusses token waste in AI agent workflows due to repeated context, introduces an open-source proxy called Badgr-auto for deduplication, and asks the community how they handle the issue.

A developer shares their experience moving from an agent platform to a self-managed stack after six months, citing better control over model selection, cost, and execution isolation, leading to a 60% drop in token costs.

A comprehensive guide explaining model routing as a technique to intelligently select the best AI model per request to optimize cost, quality, and latency, contrasting it with AI gateways and emphasizing its importance for agentic AI workloads.

The article highlights the underappreciated challenge of AI token usage economics at scale, discussing how costs become a governance issue as organizations move from proofs of concept to enterprise-wide deployment. It poses questions about cost visibility, monitoring, and balancing performance with cost.

UltraCode-Shim is an open-source tool that proxies Claude Code's UltraCode mode (xhigh effort + dynamic workflow) to any paid model via a local stdlib-only proxy, supporting dual-model orchestration with automatic routing by task difficulty.

OpenSquilla is an open-source, locally runnable AI agent that uses MetaSkill technology to automatically organize multiple skills into workflows and achieve cross-vendor intelligent model routing, significantly reducing usage costs.

The article discusses how AI products require a new 'AI integration layer' to handle context retrieval, tool execution, model routing, and observability, and references Merge.dev's infrastructure for this purpose.

The article argues that enterprise AI is moving from single-model chatbots to multi-agent architectures with specialized agents routed dynamically, explaining why this is necessary for quality, cost, and flexibility.

OpenSquilla is an open-source, locally-hosted AI Agent with intelligent model routing that allocates tasks among different models to save token costs, and introduces the MetaSkill mechanism to let the Agent automatically organize skills.

Factory Router automatically selects the best AI model for each task, claiming to cut costs by 25% while maintaining frontier performance, a promising tool for large enterprises.

Proposes UniScale, an online framework that unifies model routing and test-time scaling via contextual bandit optimization for better quality-cost trade-offs in LLM inference.