llm-gateway

LangChain announces LangSmith LLM Gateway, a runtime governance layer for AI agents that enforces cost limits, detects PII, and enables policy enforcement directly within LangSmith, now in private beta.

A founder seeks validation for a service that configures production-grade LLM gateways to address common enterprise issues like cost visibility, provider lock-in, and PII leakage using open-source tools.

LiteLLM 是一个开源 AI 网关，提供统一接口以 OpenAI 格式调用 100 多个 LLM 提供商，可作为 Python SDK 或自托管代理服务器使用，面向企业级部署。