Tag
The article examines the limitations of LLM gateways when agents can bypass them, suggesting that effective governance requires integrating egress enforcement and shadow detection to prevent unauthorized access.
The article highlights that most teams use separate tools for AI tracking and introduces Respan as a unified solution to route, observe, and evaluate LLM calls through a single gateway.
TanStack AI releases a first-party LLM Gateway adapter, enabling developers to access over 200 AI models from 40+ providers with a single API key and one-line model switching.
LangSmith's LLM Gateway now supports Kimi K3 and other open models via Gateway Credits, letting users call hosted models with just a LangSmith API key without configuring provider secrets.
LangSmith LLM Gateway is now in public beta, offering centralized governance for model calls in production agents — including spend caps, rate limits, model fallbacks, and per-customer policies to prevent outages and cost overruns.
Manifest explains why it deprecated its LLM router, arguing that model routing introduces unpredictability, breaks behavior consistency, and that prompt complexity cannot be inferred from the prompt alone, making caching and deliberate model selection more effective for most use cases.
LangChain 发布了一份概念指南，阐述了构建可控AI代理的框架，涵盖了认证、审计日志、速率限制、回退和集中化支出控制等系统级治理要素，并介绍了LLM网关作为运行时控制平面的作用。
OrcaRouter is a new AI gateway that intelligently routes prompts to the best model, offering cost savings, guardrails, and full observability with zero token markup and a free tier.
LLM Gateway Chat is a platform that provides access to multiple AI models for chat, image, video, and audio generation.
A detailed comparison of OpenRouter, Concentrate.ai, Portkey, and LiteLLM as LLM gateways for a B2B SaaS product, covering features, costs, and governance.
LangChain announces that LangSmith LLM Gateway can redact sensitive data like SSNs from requests before they reach LLM providers or logs, enhancing privacy and security.
Harbor v0.4.19 adds the ability to launch local agentic coding tools with local inference backends, integrating vllm, sglang, and llama.cpp, and includes a built-in LLM gateway for tool injection like web search.
LangChain announces LangSmith LLM Gateway, a runtime governance layer for AI agents that enforces cost limits, detects PII, and enables policy enforcement directly within LangSmith, now in private beta.
A founder seeks validation for a service that configures production-grade LLM gateways to address common enterprise issues like cost visibility, provider lock-in, and PII leakage using open-source tools.