I built 6 agent harnesses in the last 6 months, they all need a database

Reddit r/AI_Agents News

Summary

The author discusses building six AI agent harnesses and emphasizes the need for a dedicated database to track agent execution, state, and learnings, beyond just observability tools.

How do you design your agent database? So I built 6 agent harnesses in the last 6 months. Don't ask me why. In the agency you do what your customers want. Some of the best practices that I picked up while working on these in articles from Ramp, Stripe, WorkOS, OpenAI, Anthropic, HumanLayer, and Deepset are: Use small agent prompts. Let the agent cook. Use deterministic gates. Evaluate and let the agent introspect everything. Manage state. Use isolated environments. Use deterministic policies. Plus a few practices that I don't see mentioned a lot -- one of them is to have a database for the agent, kind of agent.db. With that I don't mean an application database like Lovable or Bolt give you via Supabase integration. I mean a database of what your agent does. It started with a simple execution log. I recorded the events of my agent harness, starting with dispatching tasks, running evaluations, logging the results, and so on. Since i didn't intend to make anything substantial, it was an SQLite with the basic WAL. While using it I found uses for introspection and learning, for post-hoc feature request generation, for resuming paused execution, and for giving the agent a state that is easy and fast to retrieve (which markdown files are not -- me saying this while I write the post in Obsidian). I was wondering if anybody's using databases to track what their agent does. Of course I know about agent observability with tools like Phoenix, LangFuse or thousand others that store agent traces. They're important but not the only thing I am thinking about. It's also about the queue, runs, tasks, events, and learnings in the persistent storage for the agent to have continuity and grow over time. How do you solve this besides markdown files?
Original Article

Similar Articles

How to Build a Reliable Agent Harness (48 minute read)

TLDR AI

This article serves as a postmortem and playbook for building reliable agent harnesses, detailing architectural lessons from omp and the transition to omp² while advocating for design principles that manage complexity effectively.