AI Review Loops Don't Always Stabilise

Lobsters Hottest News

Summary

The article explains that AI review loops in code development can become unstable due to inconsistent AI opinions, scope creep, and hallucinations, as shown in a test with Opus 5.

<p><a href="https://lobste.rs/s/52povq/ai_review_loops_don_t_always_stabilise">Comments</a></p>
Original Article
View Cached Full Text

Cached at: 08/26/26, 03:15 AM

# AI Review Loops Don't Always Stabilise Source: [https://kevinmahoney.co.uk/articles/ai-review-loops/](https://kevinmahoney.co.uk/articles/ai-review-loops/) 25 August 2026 It’s tempting to think that having AI review code and then implement fixes in a loop will create a flawless diamond at the end of the process\. Some are accidentally doing the slow version of this loop where dev A creates an AI\-generated PR, dev B lazily AI\-reviews it, then dev A AI\-fixes it,*ad infinitum*\. With careful guardrails this can work, but doing it naively will often create a mess for a few reasons: - AI does not have a consistent set of opinions\. What it considers good code can change from run to run\. In the worst case, it can flip\-flop from review to review, causing a never\-ending loop\. - Reviews can often encourage scope creep, from ‘Hey, you don’t have a test for this\!’, to ‘Hey, you don’t have a CI/CD pipeline\!’, to ‘Hey, you don’t have an Android app for this\!’\. - Any false positives or hallucinations in reviews can introduce new defects\. As a quick test I asked Opus 5 to generate a small amount of ‘perfect, non\-trivial’ code and passed it through three review\-fix loops\. Here is an[AI\-generated writeup](https://gist.github.com/KMahoney/3098f0f12638d0a83a5ef3b91bef601d)\. Note the defect count*increases*with each review\!

Similar Articles

AI is eating the AI Engineering Loop (5 minute read)

TLDR AI

The article discusses how the AI engineering loop can be fully automated but argues that handing over the entire loop produces 'agent slop' due to imperfect evals. It recommends automating certain steps while keeping human judgment for nuance.

The AI world is getting ‘loopy’

TechCrunch AI

The article discusses the rise of 'loops' in AI agentic systems, where agents continuously prompt other agents to perform tasks, as a major step beyond simple agent use. Boris Cherny of Claude Code endorses this approach at Meta's @Scale conference.

Reviewing AI Code Is Not A Viable Argument (2025)

Lobsters Hottest

The article argues that requiring thorough code review negates the supposed productivity gains of LLM coding assistants, as empirical research shows they do not help write code better or faster, and proponents fail to address the inherent error rates.