@rohanpaul_ai: Thier Github with 4.2k stars https://github.com/latitude-dev/latitude-llm…
Summary
Latitude is an open-source AI Agent Monitoring tool that provides issue detection, traces, and evals for LLM-based agents, similar to Sentry for AI.
View Cached Full Text
Cached at: 06/23/26, 09:54 PM
Thier Github with 4.2k stars
https://t.co/c1RcHqhmI7 https://t.co/sp1j5mXAoZ
latitude-dev/latitude-llm
Source: https://github.com/latitude-dev/latitude-llm
New: Latitude MCP server: connect your AI agent to Latitude →
Open source AI Agent Monitoring
Sentry, but for agents and LLMs.
Website · Docs · Changelog · Slack · X
🌈 Why Latitude?
Latitude shows you what will break next in your AI Agent and helps you fix it before users notice.
- Issue-centric: failed traces grouped into tracked issues, with status, size, and trend.
- Human-aligned evals: evals built automatically from your team’s judgments, with an alignment score that tracks drift from human judgment over time.
- Agent-native traces: multi-turn sessions, tool calls, and full execution paths in one view.
- Semantic search: find any trace by meaning, exact matches, or roughly similar sentences. No sampling, 100% of traces are searchable.
- Issue alerts: get notified the moment a new issue is detected or an existing one escalates. Connect Slack, email, or webhooks.
- MCP server: everything you can do in the Latitude UI, now available from your coding agent via MCP.
📚 Table of contents
- Quick start
- Integrations
- With Claude Code
- Development
- Self-host
- Community
- Contributing
- License
- Links
⚡ Quick start
You can use Latitude for free, including 20K credits/month, 30-day data retention, and unlimited seats.
Sign up at latitude.so and grab your API key and project slug.
Recommended: ask your coding agent
Paste this prompt into Claude Code, Cursor, Windsurf, Codex, OpenCode, or another coding agent:
Read the Latitude Telemetry AI skill from https://raw.githubusercontent.com/latitude-dev/skills/refs/heads/main/skills/latitude-telemetry/SKILL.md and add tracing to this application.
Manual TypeScript setup
npm install @latitude-data/telemetry
This example uses OpenAI; replace it with the LLM SDK your app already imports.
import { Latitude } from "@latitude-data/telemetry";
import OpenAI from "openai";
const latitude = new Latitude({
apiKey: process.env.LATITUDE_API_KEY!,
project: process.env.LATITUDE_PROJECT_SLUG!,
instrumentations: { openai: OpenAI },
});
const client = new OpenAI();
await client.chat.completions.create({
model: "gpt-4o",
messages: [{ role: "user", content: "Hello" }],
});
await latitude.shutdown();
Every supported LLM call now shows up as a trace in Latitude. Use capture() at request, conversation, or agent boundaries when you want to add user IDs, session IDs, tags, or metadata.
Python and any OpenTelemetry-compatible runtime are also supported. Full setup, provider guides, and OTel passthrough are in the Start tracing guide.
🔌 Integrations
Latitude is provider-agnostic. Telemetry works out of the box with most model providers and frameworks (OpenAI, Anthropic, Bedrock, Vercel AI SDK, LangChain, and more), plus any OTEL-compatible application.
See the full integration list for setup instructions.
✳️ With Claude Code
Building inside Claude Code? We have a dedicated package that captures full session transcripts as traces. Check out docs.
npx -y @latitude-data/claude-code-telemetry install
Works in the terminal, the Desktop app, and IDE extensions.
🛠️ Development
Check out the Development setup and the Contributing guide to get started contributing to Latitude.
🏠 Self-host
Latitude is self-hostable at any scale, on fully open infrastructure. Pull the ready-to-go container images on Docker Hub:
- Single-host (simple) — a production-grade instance on one machine with Docker Compose, follow the Single-host guide.
- Cluster (advanced) — a scalable, highly-available deployment on Kubernetes via a Helm chart, follow the Cluster guide.
- One-click (Railway) — the whole stack on managed infrastructure, easy deploy through Railway.
👥 Community
Join the Slack community to ask questions, share feedback, and show what you’re building.
📄 License
Latitude is licensed under the MIT License.
🤝 Contributing
Contributions are welcome. Read the Contributing Guide to get started, then join the Slack community, open an issue, or submit a pull request.
New to the project? Good first issues are a friendly place to start.
🧑💻 Thanks to all of our contributors
🔗 Links
Made with love by the Latitude Team
Similar Articles
@rohanpaul_ai: Agents token burn needs more visibility. Latitude just launched an open-source, MIT licensed monitoring platform that t…
Latitude has launched an open-source, MIT licensed monitoring platform that turns AI agent conversations into production debugging data, helping teams see sessions, catch failures, and fix issues directly from their editor.
@omarsar0: Very cool to see more focus on agent observability tools. I pointed Latitude at my Claude Code setup and immediately sa…
A tweet highlighting Latitude, an open-source agent observability tool that helps visualize AI agent actions and token usage, with the ability to catch and fix recurring failures directly from the editor.
@rohanpaul_ai: atomic[.]chat (a desktop app that runs LLMs locally) ran a very revealing comparison for local AI agents, on a MacBook …
Liquid's LFM2.5-8B-A1B outperformed OpenAI's gpt-oss-20b on a tool-calling benchmark when run locally on a MacBook Pro, completing all required tool calls in half the time while using less memory.
@rohanpaul_ai: 2. Here, I’m using LobeHub as a Chief Agent Operator to build a mini Twitter growth workflow: one agent monitors AI tre…
Rohan Paul demonstrates using LobeHub as a chief agent operator to orchestrate multiple AI agents for a Twitter growth workflow, including trend monitoring, research, thread writing, and scheduling without connecting his X account.
I built AgentLighthouse, a local “Lighthouse for AI agents” that scans repos/docs/APIs for agent readiness
AgentLighthouse is a local-first tool that scans repositories, docs, and APIs to assess how well AI coding agents (like Codex, Claude Code, Cursor) can understand and use a project. It checks for agent instruction files, documentation quality, setup clarity, OpenAPI operation quality, MCP tool descriptions, and more.