Your coding agent says "done." It never actually checked if the thing works in a browser.
Summary
A critique of AI coding agents that claim tasks are complete without verifying functionality in a real browser environment.
Similar Articles
[Discussion] Do AI coding agents say “done” too early for you too?
Discussion about AI coding agents claiming completion prematurely, skipping checks, and making messy changes. The author is testing a system with planning and review gates to improve AI-coding workflows.
The worst coding agent failure is when it says “done” too early
The article highlights a common failure mode in coding agents where they report tasks as 'done' while leaving hidden issues like insufficient tests, missed edge cases, and introduced bugs, creating a trust problem for developers.
When an AI agent says “done” how do you know it actually happened? [P]
The article explores an early concept called agentuptime, which addresses verifying AI agent actions by independently checking outcomes to ensure that an agent's completion claim matches the actual state of external systems.
Outside verification has been the missing piece in my coding-agent runs
The author notes that external verification is a crucial missing component in effectively using AI coding agents.
How do you know when an AI coding agent is actually done?
The author built OpenPitStop, an open-source tool that independently checks and verifies the work of AI coding agents, demonstrated on a broken application, and invites discussion on how to trust AI changes.