@jamonholmgren: I'm just going to dump my whole agentic setup out here, because I see too many people missing giant chunks of this and …
Summary
Jamon Holmgren shares his comprehensive agentic development setup, including workflow docs, self-healing docs, cross-agent review, automated testing, and autonomous agent loops.
View Cached Full Text
Cached at: 07/12/26, 12:53 PM
I’m just going to dump my whole agentic setup out here, because I see too many people missing giant chunks of this and it’s hurting them.
Here’s what I have and recommend:
-
an AGENTS.md that is a router – it sends the agent to the right skills, docs, tools
-
a standard workflow doc/skill customized to my needs … (grab Matt Pocock skills if you don’t already have something) … I tag this in most sessions with
@/AGENT_WORKFLOW.mdand it pulls it in. -
self-healing docs for every system, and agents are instructed to keep them updated … I tag the ones I know I need, or let the agent find them through AGENTS.md … I also provide a more detailed summary in the first 7 lines of every doc, so they’re easily greppable to find the right thing, and this is documented in AGENTS.md
-
agents always run the app … the agent should always actually run the app itself, and test its work and fix issues as it goes, especially if running autonomously / asynchronously
-
end-to-end tests and instructions to write more and keep up to date, and docs on how to write tests, what to avoid, and a list of all the tests and what they test in yet another markdown doc … write and run targeted tests during implementation, improve and commit with work
-
custom linters at precommit hooks looking for any problems you run across, with
--fixfixing the problems automatically, OR if that’s not feasible, it shells out to a cheaper LLM like Composer 2.5 or Sonnet to fix the problems – NOT just flagging them, but actually resulting in cleaned code -
cross-agent review at each major point: research, plan, implementation, and wrap-up. I mean codex, claude, cursor, whatever – but it shouldn’t be the same model reviewing the same code. And specific docs for agent review, what to look for, how to approach it. Also, personas – looking at the code from different perspectives, such as maintainability, code quality, security, performance, AI smells, domains (e.g. “financial services expert” or whatever) … and each persona also “owns” a set of system docs too and keeps them up to date
-
agent traces / worksheets that track what the agent is doing each session. if the agent fails partway through, you should be able to hand this worksheet to another agent and it could finish the job. commit this worksheet with the work so it’s all connected and easy to reference later (you will reference these later!!), also have the agent apply git tags that correspond to specific worksheet names so they’re easy to find
-
automatic agent feedback to you at the end of the session, added to a doc that is also committed with the work, that you periodically ingest into an interactive session and improve your workflows
-
a tools or bin folder that contains python or bash scripts that the agent has skills to make to make its job easier (for example, I have an
agent_reviewbash script that lets the agent kick off agent reviews via CLI without knowing each agent’s particular incantations) … docs on how to make scripts effectively, and instructions to constantly build these out more -
periodic agent sweeps through recent commits, looking for problems / gotchas from a higher level across commits
-
a coding conventions doc that is just for specific coding conventions you want to see in the code base, your review agents use these a lot (but a lot of this should be in linters)
-
an agent loop / night shift skill for autonomous work, that lays out how the agent is to approach this, from an orchestration standpoint
-
a task queue that is accessible to the agent (mine is just a TODOS.md, but yours might be in Linear etc, with a CLI to fetch via API)
-
a periodic false-confidence test audit skill that looks for tests that aren’t actually testing what you think they’re testing, and that fix those
-
visual regression tests – take screenshots, compare via tool and with agent visual review, commit with work (git lfs useful here) or at least push into the PR
-
automatic performance benchmark tests that notice when performance degrades
-
performance profiling tools that can be used by agents for targeted benchmarking, trying new techniques, comparing outputs, and comparing profiles
-
end-of-shift full validations, including running all tests, performance, agent reviews, sweeps, everything – when you return, it’s all as pristine as it can be
If you have all this, your agentic coding experience is going to be very different than dry prompting and manually guiding it toward the right thing every time.
Similar Articles
@yoheinakajima: my current @activegraphai inspired approach to a modular repo-centric agent operating system
Yohei Nakajima outlines a repo-centric modular architecture for agentic work, where the durable unit is a governed project repository rather than the model or conversation, with agents acting as replaceable execution components over persistent state.
@0xCodila: Andrew Ng just dropped 8-page PDF on 4 agentic steps "from Loops to Graphs from scartch" The twist: agent has amnesia w…
Andrew Ng released an 8-page PDF detailing four key agentic workflows: reflection, tool use, planning, and multi-agent collaboration, emphasizing that a weak model with proper architecture can outperform a strong one.
Most “agentic AI” conversations feel too abstract. Here is how my agentic research system looks like
The author shares a practical breakdown of an agentic research system they built to identify and evaluate AI use cases within companies. The system uses six agents for discovery, evaluation, and context extraction, emphasizing human-in-the-loop decision-making over full autonomy.
@yoheinakajima: great article, mostly focused on coding agents but applies elsewhere impo. aligns w a lot of my prior thoughts: - agent…
A tweet highlighting key principles for building agent systems, emphasizing scaffolding, memory, and reusable tools, based on an article by Yohei Nakajima.
Most multi-agent setups are a room full of people wearing headphones. Here's what I changed.
The author shares insights from building a multi-agent infrastructure, identifying 'identity drift' as a key challenge solved by implementing strict agent passports and file-access controls.