@copyconstruct: end-to-end testing > unit tests, in the vibecoding era. A massive, almost entirely agent-coded refactor passed all unit…
Summary
A developer argues that end-to-end testing is more important than unit tests in the age of AI coding agents, after an agent-coded refactor passed all unit tests but broke a critical feature that was only caught by manual end-to-end checks.
View Cached Full Text
Cached at: 05/15/26, 09:02 AM
end-to-end testing > unit tests, in the vibecoding era.
A massive, almost entirely agent-coded refactor passed all unit and pre-merge tests but broke a critical feature.
It was only caught due to my own excessive paranoia making me run end-to-end tests before the prod deploy.
Similar Articles
@mstockton: Kind of. If by vibecoding you mean that they built a set of robust evals to prove their re-write was correct, and that …
A developer discusses how Anthropic's backend rewrite to Rust involved building robust evals and parallel-running systems to verify correctness, arguing that constraining non-deterministic AI tools is the key challenge in AI-assisted coding right now.
@RayFernando1337: I find the latest models write a lot of unit tests. Most of them restate the code they were written after, so they alwa…
A tweet criticizes AI models for writing ineffective unit tests and shares a prompt to enforce better testing practices, emphasizing E2E tests and avoiding unit tests written after code.
AI coding agent output verification in 2026: read the diff, vibe check it, merge
A reflection on current practices for verifying AI coding agent output, noting that developers often skim diffs and merge without fully auditing the agent's session activity, raising concerns about code review culture in the age of AI.
Stop letting engineers "vibe check" your AI Agents
The author introduces an open-source, no-code tool designed to allow non-technical subject matter experts in healthcare and law to evaluate AI agents, moving beyond developer-centric testing methods.
Nobody's Testing AI Coding Agents Enough
This article discusses the insufficient testing of AI coding agents, highlighting a critical gap in ensuring their reliability and safety in software development.