Tag
Building an open-source API gateway for agentic AI workflows that provides visualization of multi-LLM and tool calls, tracking tokens, cost, and latency without requiring code instrumentation. Uses Rust and Go servers with a Python correlator, seeking collaborators and feedback from AI ops users.
The author shares how running multiple persistent AI agent profiles under Hermes led to high API costs, solved by implementing tiered model policies per profile, pre-processing inputs, and using an API gateway for cost visibility, reducing daily costs from $14-18 to $7-10.
Grok2API 是一个开源的 Grok API 网关，支持 Grok Build、Grok Web 和 Grok Console 多账号池，提供 OpenAI 兼容接口和管理后台，方便开发者集成。
OpenWA is a free, open-source WhatsApp API Gateway with a pluggable architecture, multi-session support, Docker deployment, and a full React dashboard, giving developers full control over their messaging infrastructure without vendor lock-in.