Tag
LangChain 发布了一份概念指南，阐述了构建可控AI代理的框架，涵盖了认证、审计日志、速率限制、回退和集中化支出控制等系统级治理要素，并介绍了LLM网关作为运行时控制平面的作用。
OrcaRouter is a new AI gateway that intelligently routes prompts to the best model, offering cost savings, guardrails, and full observability with zero token markup and a free tier.
LLM Gateway Chat is a platform that provides access to multiple AI models for chat, image, video, and audio generation.
A detailed comparison of OpenRouter, Concentrate.ai, Portkey, and LiteLLM as LLM gateways for a B2B SaaS product, covering features, costs, and governance.
LangChain announces that LangSmith LLM Gateway can redact sensitive data like SSNs from requests before they reach LLM providers or logs, enhancing privacy and security.
Harbor v0.4.19 adds the ability to launch local agentic coding tools with local inference backends, integrating vllm, sglang, and llama.cpp, and includes a built-in LLM gateway for tool injection like web search.
LangChain announces LangSmith LLM Gateway, a runtime governance layer for AI agents that enforces cost limits, detects PII, and enables policy enforcement directly within LangSmith, now in private beta.
A founder seeks validation for a service that configures production-grade LLM gateways to address common enterprise issues like cost visibility, provider lock-in, and PII leakage using open-source tools.