The AI productivity numbers don't match what I actually see on my team
Summary
The author, running a small dev team, shares mixed real-world results from using AI coding tools: they speed up boilerplate and onboarding, but produce confident wrong answers on complex problems and increase code review workload, yielding modest net gains far below the often-cited 10x improvement.
Similar Articles
The AI Productivity Gap
An analysis of the 'AI productivity gap' in software engineering, arguing that AI mainly speeds up the coding portion of developers' jobs while leaving other crucial tasks like design, reviews, and meetings largely unchanged, leading to only modest overall gains. It also notes juniors benefit more than seniors, contrary to some leaders' assumptions.
The Honest Math of AI Productivity
A critical analysis of exaggerated AI productivity claims, citing rigorous studies that show modest gains (15-40%) compared to the 5-10x often claimed by vendors, and warns against uncritical adoption of such hype.
Could this be the reason why some people see large coding productivity improvement, while others almost nothing?
This paper investigates why some developers experience significant coding productivity improvements from AI assistance while others see little to no benefit, exploring factors that may explain the variance.
Are AI coding agents hitting a wall, or are we just measuring them wrong?
This article examines the gap between hype and reality for AI coding agents, arguing that they are effective for accelerating workflow parts but still require human oversight for architecture, debugging, and review, and questioning whether current benchmarks measure the right things.
@rohanpaul_ai: MIT study. Code volume surges by 300%, but output increases by only 30%: The AI dividend meets an awkward reality. They…
An MIT study of over 100,000 GitHub developers finds that AI coding tools increase code volume by up to 300% but only boost shipped software by 30%, highlighting bottlenecks in human review and integration.