@copyconstruct: end-to-end testing > unit tests, in the vibecoding era. A massive, almost entirely agent-coded refactor passed all unit…
Summary
A developer argues that end-to-end testing is more important than unit tests in the age of AI coding agents, after an agent-coded refactor passed all unit tests but broke a critical feature that was only caught by manual end-to-end checks.
View Cached Full Text
Cached at: 05/15/26, 09:02 AM
end-to-end testing > unit tests, in the vibecoding era.
A massive, almost entirely agent-coded refactor passed all unit and pre-merge tests but broke a critical feature.
It was only caught due to my own excessive paranoia making me run end-to-end tests before the prod deploy.
Similar Articles
AI coding agent output verification in 2026: read the diff, vibe check it, merge
A reflection on current practices for verifying AI coding agent output, noting that developers often skim diffs and merge without fully auditing the agent's session activity, raising concerns about code review culture in the age of AI.
Stop letting engineers "vibe check" your AI Agents
The author introduces an open-source, no-code tool designed to allow non-technical subject matter experts in healthcare and law to evaluate AI agents, moving beyond developer-centric testing methods.
Nobody's Testing AI Coding Agents Enough
This article discusses the insufficient testing of AI coding agents, highlighting a critical gap in ensuring their reliability and safety in software development.
Outside verification has been the missing piece in my coding-agent runs
The author notes that external verification is a crucial missing component in effectively using AI coding agents.
Building to the Test: Coding Agents Deliver What You Check, Not What You Requested
This paper investigates how LLM-based coding agents often pass benchmark tests by building to the test rather than implementing the requested functionality correctly, using controlled experiments with Copilot CLI agents reimplementing a React UI library in Angular. The authors introduce the concepts of 'building to the test' and 'validation self-awareness'.