The AI productivity numbers don't match what I actually see on my team

Reddit r/artificial News

Summary

The author, running a small dev team, shares mixed real-world results from using AI coding tools: they speed up boilerplate and onboarding, but produce confident wrong answers on complex problems and increase code review workload, yielding modest net gains far below the often-cited 10x improvement.

I help run a small dev team and I've spent the last year trying to figure out if these tools made us faster or just made us feel faster. Genuinely not sure yet. The wins are real but boring. Boilerplate, test scaffolding, the fifth CRUD endpoint that's basically the other four with different names. Onboarding got a bit easier too because the juniors can ask an assistant the stuff they'd feel dumb asking me for the tenth time. Then there's everything that needs you to actually understand why the code is there. Race conditions, how two services should talk to each other, cleaning up a mess someone left behind two years ago. There the assistant is confident and wrong a lot, and confident-and-wrong is honestly worse than slow. The thing nobody warned me about was review. We write code faster now, so there's more of it to read, and reading code is harder than writing it. We've shipped stuff that compiled, passed lint, passed the tests, and was still quietly the wrong thing, because whoever was "writing" it had mentally clocked out halfway through. So net positive maybe? But nowhere near the 10x people keep selling. Curious about others actually using this on a team and not a weekend project. Where's it genuinely helped, and where's it just created new work in a different spot?
Original Article

Similar Articles

The AI Productivity Gap

Hacker News Top

An analysis of the 'AI productivity gap' in software engineering, arguing that AI mainly speeds up the coding portion of developers' jobs while leaving other crucial tasks like design, reviews, and meetings largely unchanged, leading to only modest overall gains. It also notes juniors benefit more than seniors, contrary to some leaders' assumptions.

The Honest Math of AI Productivity

Reddit r/ArtificialInteligence

A critical analysis of exaggerated AI productivity claims, citing rigorous studies that show modest gains (15-40%) compared to the 5-10x often claimed by vendors, and warns against uncritical adoption of such hype.

Are AI coding agents hitting a wall, or are we just measuring them wrong?

Reddit r/AI_Agents

This article examines the gap between hype and reality for AI coding agents, arguing that they are effective for accelerating workflow parts but still require human oversight for architecture, debugging, and review, and questioning whether current benchmarks measure the right things.