@rauchg: We've been explaining AI Gateway as a C̶o̶n̶t̶e̶n̶t̶ Token Delivery Network. Like a CDN for AI models. One great featur…

X AI KOLs Following Products
ai-gateway vercel model-routing rewrite-rules cdn token-delivery-network production

Summary

Vercel's AI Gateway now supports routing rules that allow developers to dynamically rewrite model routes (e.g., from retired models like Claude Fable-5 to Claude Opus-5) without code changes, ensuring production workloads remain resilient.

We've been explaining AI Gateway as a C̶o̶n̶t̶e̶n̶t̶ Token Delivery Network. Like a CDN for AI models. One great feature of CDNs is the ability to dynamically re-route or deny traffic without redeployment. When Fable was suddenly retired, we worried about production workloads depending on it. Even Fable aside, models get retired quite often as GPU capacity is heavily contested. Yet our data shows people still having happy production traffic of older model versions! We're solving this now with AI Gateway Rules. e.g.: you can now rewrite model "routes" on the fly! 𝚟𝚎𝚛𝚌𝚎𝚕 𝚊𝚒-𝚐𝚊𝚝𝚎𝚠𝚊𝚢 𝚛𝚞𝚕𝚎𝚜 𝚊𝚍𝚍 \ --𝚝𝚢𝚙𝚎 𝚛𝚎𝚠𝚛𝚒𝚝𝚎 \ --𝚜𝚘𝚞𝚛𝚌𝚎 𝚊𝚗𝚝𝚑𝚛𝚘𝚙𝚒𝚌/𝚌𝚕𝚊𝚞𝚍𝚎-𝚏𝚊𝚋𝚕𝚎-𝟻 \ --𝚍𝚎𝚜𝚝𝚒𝚗𝚊𝚝𝚒𝚘𝚗 𝚊𝚗𝚝𝚑𝚛𝚘𝚙𝚒𝚌/𝚌𝚕𝚊𝚞𝚍𝚎-𝚘𝚙𝚞𝚜-𝟻 This adds to the repertoire of capabilities and techniques AI Gateway brings to the table to recover lost tokens. If you drop tokens, you lose revenue and customers Kudos to @rtaneja_ @crowprose @shaper – we went from CLI design to production-grade capability very quickly!
Original Article
View Cached Full Text

Cached at: 07/04/26, 06:42 AM

We’ve been explaining AI Gateway as a C̶o̶n̶t̶e̶n̶t̶ Token Delivery Network. Like a CDN for AI models.

One great feature of CDNs is the ability to dynamically re-route or deny traffic without redeployment.

When Fable was suddenly retired, we worried about production workloads depending on it. Even Fable aside, models get retired quite often as GPU capacity is heavily contested. Yet our data shows people still having happy production traffic of older model versions!

We’re solving this now with AI Gateway Rules. e.g.: you can now rewrite model “routes” on the fly!

𝚟𝚎𝚛𝚌𝚎𝚕 𝚊𝚒-𝚐𝚊𝚝𝚎𝚠𝚊𝚢 𝚛𝚞𝚕𝚎𝚜 𝚊𝚍𝚍
–𝚝𝚢𝚙𝚎 𝚛𝚎𝚠𝚛𝚒𝚝𝚎
–𝚜𝚘𝚞𝚛𝚌𝚎 𝚊𝚗𝚝𝚑𝚛𝚘𝚙𝚒𝚌/𝚌𝚕𝚊𝚞𝚍𝚎-𝚏𝚊𝚋𝚕𝚎-𝟻
–𝚍𝚎𝚜𝚝𝚒𝚗𝚊𝚝𝚒𝚘𝚗 𝚊𝚗𝚝𝚑𝚛𝚘𝚙𝚒𝚌/𝚌𝚕𝚊𝚞𝚍𝚎-𝚘𝚙𝚞𝚜-𝟻

This adds to the repertoire of capabilities and techniques AI Gateway brings to the table to recover lost tokens. If you drop tokens, you lose revenue and customers

Kudos to @rtaneja_ @crowprose @shaper – we went from CLI design to production-grade capability very quickly!

Vercel Developers (@vercel_dev): AI Gateway now supports routing rules.

Migrate to new models by setting rules in the CLI, no code changes in your app or agent required.

Similar Articles

We Built a Unified API Gateway for AI Agents — Lessons Learned

Reddit r/AI_Agents

We built a unified API gateway for AI agents supporting multiple models like Claude, GPT, Codex, and Gemini through a single OpenAI-compatible endpoint. It simplifies integration, billing, and deployment for developers building AI agents and SaaS products.

AI Gateway Production Trends (8 minute read)

TLDR AI

Vercel's AI Gateway data shows Anthropic leads in spending, Google in token volume, and agentic workloads carrying 59% of token volume. OpenAI's spend share tripled after recent model updates.

@tomas_hk: yes it is have written our learnings here:

X AI KOLs Following

A comprehensive guide explaining model routing as a technique to intelligently select the best AI model per request to optimize cost, quality, and latency, contrasting it with AI gateways and emphasizing its importance for agentic AI workloads.