Tag
TokenShield, an open-source FastAPI gateway proxy, now uses per-turn sliding window hashes to prevent agent retry loops in CrewAI, reducing token waste and cost.
The article describes how building an intelligent caching gateway (Hawiyat Composer) saved significant AI API costs by eliminating repeated token waste through exact-match caching, semantic caching, model routing, and local routing.
Building an open-source API gateway for agentic AI workflows that provides visualization of multi-LLM and tool calls, tracking tokens, cost, and latency without requiring code instrumentation. Uses Rust and Go servers with a Python correlator, seeking collaborators and feedback from AI ops users.
The author shares how running multiple persistent AI agent profiles under Hermes led to high API costs, solved by implementing tiered model policies per profile, pre-processing inputs, and using an API gateway for cost visibility, reducing daily costs from $14-18 to $7-10.
Grok2API 是一个开源的 Grok API 网关，支持 Grok Build、Grok Web 和 Grok Console 多账号池，提供 OpenAI 兼容接口和管理后台，方便开发者集成。
OpenWA is a free, open-source WhatsApp API Gateway with a pluggable architecture, multi-session support, Docker deployment, and a full React dashboard, giving developers full control over their messaging infrastructure without vendor lock-in.