I open-sourced "AWS for AI." One docker compose for governed, compliant, auditable AI for your whole org. Gateway, guardrails, policies, observability, audit, etc - all wired together, built on open source.
Summary
An open-source Docker Compose setup integrating multiple open-source tools (LiteLLM, LLM Guard, OpenBao, Langfuse, etc.) to provide a governed, compliant, and auditable AI platform for organizations, with a user-friendly interface for building governed workflows.
Similar Articles
I built an open-source platform for creating and managing AI agents (MIT licensed, free to self-host)
The author built an open-source, MIT-licensed platform for creating and managing AI agents, featuring provider-agnostic support, MCP integration, memory, skills, scheduled triggers, and Kanban boards, deployable via Docker Compose.
My Homelab AI Dev Platform
The author describes setting up an AI dev platform in his homelab using OpenCode Web UI with Git access, enabling AI-assisted maintenance of Docker services via PR review and GitOps deployment.
OpenKite - Opensource AWS DevOps AI Agent
OpenKite is a new open-source AI agent for AWS DevOps that uses LangGraph and boto3 to automate cloud management tasks with built-in human approval workflows and audit logging.
Open-source setup needed 22 services just to run. Now the default is three containers.
An open-source platform for testing and monitoring AI apps/agents reduced its default self-hosted setup from 22 services to three containers (app + Postgres + ClickHouse), running on a laptop with ~4GB Docker resources, while keeping the full production-scale architecture as an opt-in.
AI Observability by OpenObserve
OpenObserve launches an AI-native, open-source observability platform designed to trace AI agents and LLMs, offering detailed insights into performance, cost, and quality for developers.