MIT's claim that 95% of AI pilots fail - Is this true?

# The 95% AI failure stat, one year later: junk number, real problem Source: [https://coffeecupai.com/blog/95-ai-failure-stat-one-year-later-junk/](https://coffeecupai.com/blog/95-ai-failure-stat-one-year-later-junk/) AI ROI · Data study MIT's claim that 95% of AI pilots fail rested on a misread funnel and 153 survey responses\. The 2026 critiques dismantled the number\. But a full year of follow\-up data from McKinsey, Deloitte, Capgemini, and government statistics shows the diagnosis behind it largely held up\. Here is the ledger\. Enterprise AI adoption is rising faster than measurable financial returns\.New evidence separates a flawed 95 percent failure statistic from the workflow and measurement problems that continue to stall AI ROI\.In August 2025, a 26\-page preliminary report from MIT's NANDA initiative became essential reading for[AI consulting and implementation planning](https://coffeecupai.com/ai-consulting/)\. It claimed that 95% of enterprise generative AI pilots were failing, delivering little or no measurable impact on profit and loss despite $30–40 billion in cumulative spending\. Fortune published the headline on a Monday\. Yahoo Finance reported that the MIT number[had spooked investors](https://finance.yahoo.com/news/mit-report-95-ai-pilots-165754716.html)\. By Friday the figure had been repeated by Forbes, Axios, and Harvard Business Review, had anchored a popular thread on r/stocks titled "The actual reason Nasdaq dropped today," and had become the single most\-cited data point in the argument that AI was overhyped\. Fifteen months later, the data cycle is complete\. McKinsey surveyed 1,719 executives across 97 countries in mid\-2026\. Deloitte fielded its annual enterprise AI study\. Capgemini surveyed 1,500 leaders across 15 countries\. The US Census Bureau, the UK Office for National Statistics, and Eurostat all published economy\-wide adoption counts\. And one podcaster read the MIT report closely enough to show that the headline number described something that never happened\. The 95% figure was junk: it was computed from a denominator the report never justified, by authors with a commercial interest in the solution it recommended\. The pattern the figure pointed at, though, survived the year in dataset after dataset\. Most enterprise AI spending still has not reached the P&L, the gap sits in workflows and measurement rather than in models, and executives' picture of AI adoption is roughly four times rosier than the picture drawn by government business registers\. ## How a misread funnel became the most famous number in AI [The GenAI Divide: State of AI in Business 2025](https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf)was explicit, on its first page, that it reported "preliminary findings\." Its method: a review of roughly 300 publicly disclosed AI initiatives, interviews with 52 organizations, and 153 survey responses collected at industry conferences\. The authors, Aditya Challapally, Chris Pease, Ramesh Raskar, and Pradyumna Chari, wrote that 95% of organizations were getting zero return from generative AI\. In February 2026, Rob Wiblin of 80,000 Hours published[a line\-by\-line rereading](https://forum.effectivealtruism.org/posts/q92qq7XCCLJonA6CH/the-story-behind-the-bad-ai-stat-that-moved-markets-and)of the report\. His central finding: the 95% was not a failure rate among pilots\. Roughly four out of five organizations in the survey had never run a custom, task\-specific generative AI pilot at all\. The report counted every one of those non\-starters as a failure and divided by the total\. Wiblin's analogy: reporting that 95% of a dating app's users have failing marriages when 80% of them never went on a date\. The funnel that produced "95%" One square per surveyed organization, as reconstructed from the report's own survey by its critics\. The headline divided everything outside the orange squares by the whole grid\. **Never piloted custom task\-specific GenAI**\(~80 of 100\)**Piloted, no successful deployment**\(~15\)**Working deployment**\(~5\) Proportions approximate the breakdown Wiblin reconstructed from the report's survey tables; the report itself did not publish the funnel in this form\. Critiques also note that surveyed organizations skewed more satisfied than dissatisfied with their AI implementations, and that pilots stalled most often over organizations' unwillingness to adopt new tools rather than over the tools' performance\.The critiques went further\. The report's own survey data, Wiblin noted, showed more organizations satisfied with their implementations than dissatisfied\. The authors did not disclose that several of them develop and sell the agentic\-AI infrastructure the report recommends as the fix, a conflict of interest that matters because the report's most quotable sub\-finding was that externally purchased and partnered AI solutions succeed about 67% of the time while internal builds succeed about a third as often\. A study recommending that companies buy from outside vendors, produced by people selling to those companies, deserves more scrutiny than a press\-release funnel received before the number moved markets\. The real lesson isn't about artificial intelligence\. It's how a confusing report based on 52 interviews and 153 survey results could get the MIT stamp, go viral through Fortune, and move the Nasdaq before anyone read it\.Rob Wiblin, 80,000 Hours, April 2026 So the number deserves no weight in any budget decision you make this quarter\. But dismissing it wholesale would repeat the original error in reverse, because the report also made claims about*why*AI projects stall\. Those claims are testable, and a year of independent data has now tested them\. ## What the 2026 data shows: the ledger McKinsey's State of AI 2026 survey, fielded in May and June 2026 across 1,719 participants in 97 countries, is the cleanest follow\-up available\. Its headline pair: roughly 88% of organizations now use AI regularly in at least one function, while only 37% report any positive contribution to EBIT,[exactly the same share as the year before](https://www.digital-chiefs.de/en/mckinsey-eight-out-of-ten-companies-accelerate-with-ai-while-ebit-remains/)\. Six percent of organizations qualify as high performers, attributing at least 5% of operating profit to AI, also unchanged\. Meanwhile 80% of individual respondents say AI has made their own work faster\. The adoption–impact gap, measured McKinsey State of AI 2026, n = 1,719 across 97 countries\. Each bar is a different question, asked of the same respondents\. Use AI regularlyin at least one function 88% Personally fasterAI accelerated their own work 80% Positive EBIT impactany measurable contribution 37% High performers≥5% of EBIT attributed to AI 6% Adoption and self\-reported speed are near\-saturated; financial impact is flat\. The 51\-point drop between "personally faster" and "positive EBIT" is the distance the money still has to travel\. Source: McKinsey, The State of AI 2026\.One year later: what moved and what didn't McKinsey surveys, 2025 vs 2026\. Gray dot: prior year\. Orange dot: 2026\. Organizations reporting positive EBIT impactflat year over year 37% → 37% High performers \(≥5% of EBIT from AI\)flat year over year 6% → 6% High performers redesigning workflows around AIup 20 points 55% → ~75% Headcount actually reduced by AIagainst 32% who had expected it 32% expected → 14% experienced Financial outcomes did not move at all in a year of sharply rising usage\. The variables that did move were workflow redesign among high performers and the gap between expected and experienced headcount effects\. Source: McKinsey, The State of AI 2026 \(May–June 2026\)\.That gives five testable claims from the original report, and a year of independent data to grade them against\. The verdict ledger: five claims from the 95% report, graded by 2026 data MIT claim, 2025What the 2026 data showsVerdict95% of GenAI pilots failThe figure misread the report's own funnel; ~80% of surveyed orgs never piloted custom GenAI\. No 2026 dataset reproduces it: 37–39% of large organizations report some EBIT impact \(McKinsey\), 66% report measurable productivity and decision\-quality gains \(Capgemini\), while 25% have moved at least 40% of pilots into production \(Deloitte\)\.Wrong as statedThe bottleneck is organizational: the "learning gap," not model qualityHeld up across every major survey\. 80% of individuals work faster while EBIT stays flat\. High performers redesign workflows ~3x more often than the rest \(~75% vs ~25%\)\. Gartner predicts over 40% of agentic AI projects will be canceled or re\-architected by end of 2027, citing unclear business value and weak integration\.Held upMoney goes to sales and marketing; the returns sit in back\-office automationThe misallocation persists: Capgemini \(Jan 2026\) finds more than half of organizations still prioritize AI investment in sales, marketing, and IT operations\. Whether back office still pays better is unresolved by 2026 data; budgets have not been rebalanced either way\.Behavior persists; returns unresolvedBuying from vendors succeeds ~67% of the time; building in\-house ~33%Contested at the time \(conflicted authors, opaque data\) and partly overtaken by events: McKinsey 2026 finds 32% of organizations declined to buy at least one software product because coding agents built the functionality in\-house\. The build\-versus\-buy boundary is moving, not settled in vendors' favor\.Contested, then mootedShadow AI is everywhere: employees run unsanctioned toolsHeld up\. UK ONS \(July 2026\): 35% of businesses use at least one AI technology, the average adopter uses 1\.6, and only 10% describe use as extensive, meaning most usage is informal and lightly governed rather than enterprise\-deployed\.Held upSources: McKinsey State of AI 2026 and 2025; Deloitte State of AI in the Enterprise, Jan 2026; Capgemini Research Institute, Jan 2026; Gartner, June 2025; UK ONS, July 2026; Wiblin's reconstruction of the MIT NANDA survey\.## The perception gap nobody quotes One finding in the 2026 data deserves more attention than it has received: the population that believes AI adoption is universal is not the population where adoption is universal\. Executive surveys and business registers are describing different economies\. Two pictures of AI adoption Executive surveys versus government business registers, 2026\. "Mid\-size/large" shows the rate for bigger firms where the surveys' respondents actually work\. McKinsey survey of executivesuse AI regularly in at least one function 88% US Census Bureau, May 2026all US businesses; 37% among firms with 250\+ staff 17–20% UK ONS, July 2026businesses with 10\+ staff; 49% among 250\+ 35% Eurostat, 2025EU enterprises with 10\+ staff; 55% among large 20% Registration\-based surveys count every business, including small firms that dominate any economy\. Executive surveys over\-sample large companies with AI programs\. Both are true; they answer different questions\. Sources: McKinsey State of AI 2026; US Census Bureau Business Trends and Outlook Survey; UK ONS; Eurostat; compiled by[iTechnoSol's October 2026 review](https://itechnosol.com/research/ai-adoption-mid-size-businesses/)\.The practical consequence: if you run a mid\-size company, "88% of organizations use AI" is not a description of your competitive field\. It is a description of the conference circuit\. Your actual field looks like 32–37% in the US for firms your size, 49% in the UK, and 30–55% across Europe depending on headcount\. That changes the urgency calculation\. You are not late to a race everyone is running; you are deciding whether to join a race that a third to half of your peers have entered, most of them shallowly\. ## Why speed hasn't become profit The most consistent 2026 finding, 80% of people working faster against a flat 37% reporting profit impact, has a mechanism, and it is the same mechanism the MIT report identified before anyone trusted it\. McKinsey's analysts put it plainly: while workflows stay unchanged, faster individual work saves calendar time without appearing on the income statement\. Where the money goes missing between a license and a P&L line Step 1**Tokens bought** Seats, API spend, subscriptions\. Costs land on the books immediately\. → Step 2**Individual tasks get faster** Drafts, summaries, lookups\. 80% of respondents feel this\. → Step 3**Workflow stays unchanged** Same handoffs, approvals, staffing, and throughput targets as before\. → Step 4**Time saved, output constant** Faster steps inside an unchanged process produce slack, not volume\. → Step 5**Nothing reaches the P&L** No revenue added, no cost removed\. EBIT stays at 37% reporting, year after year\. The high\-performer escape hatch sits at step three: ~75% of organizations attributing 5%\+ of EBIT to AI redesign workflows around it, against ~25% of everyone else\. Source: McKinsey State of AI 2026; the chain is our synthesis of its findings\.The same survey shows what the escape looks like\. High performers, the 6%, are roughly three times more likely to rebuild a process around AI than to bolt a tool onto an existing one, and that share rose from 55% to about 75% in a year while everyone else stayed near a quarter\. They also target growth and innovation, not just efficiency, and they measure outcomes\. Everything else in the 2026 data is noise around that mechanism\. Two secondary findings deserve a line each\. Expectations are running systematically ahead of experience: 32% of organizations expected AI to cut headcount, 14% experienced it, and only 13% of respondents feel their own job threatened\. And token economics have started to bite: one in five organizations already limits AI use because of per\-token operating costs, even as 60% plan to spend more next year\. Capgemini found budgets rising from 3% to 5% of annual business spend, committed on five\-year horizons, largely ahead of demonstrated returns\. ## What this means if you are signing an AI budget Three conclusions survive the year's evidence\. First, do not freeze spending because of the 95% figure, and do not expand it because of the 88% figure\. Both are artifacts of bad denominators: one divided failures by organizations that never started, the other counts a single function's usage as adoption\. The honest base rate for planning is that roughly a third of comparable organizations report measurable financial impact, and the share has not moved in a year\. Plan against that number\. Second, spend on workflow redesign, not on licenses\. The single variable that separates high performers in every 2026 dataset is whether the process itself changed\. Concretely: pick one workflow with a measurable baseline \(cycle time, error rate, cost per case\), redesign it end to end with AI inside it, and hold the before\-and\-after numbers\. A tool added to an unchanged process buys calendar time you will never bill\. Third, make expectations a written contract with yourself\. The data shows organizations expecting twice as much as they experience, on headcount and returns alike\. Before a pilot starts, write down the baseline, the result that would count as success, and the decision rule for continuing, changing, or stopping\. Deloitte's survey found only a quarter of organizations have moved 40% of their pilots into production; the difference between a portfolio of perpetual pilots and a portfolio of decisions is that written rule\. The 95% statistic will keep circulating\. It is too convenient for the skeptics and too scary for the boosters to die\. When someone quotes it at you, you now know the number is junk and the diagnosis underneath it is real: the models were never the bottleneck, the workflow is, and a year of data says the only companies escaping are the ones that rebuilt one\. Primary sources: MIT Project NANDA,[The GenAI Divide: State of AI in Business 2025](https://mlq.ai/media/quarterly_decks/v0.1_State_of_AI_in_Business_2025_Report.pdf); Fortune's original coverage; Rob Wiblin's[critique and reconstruction](https://forum.effectivealtruism.org/posts/q92qq7XCCLJonA6CH/the-story-behind-the-bad-ai-stat-that-moved-markets-and); McKinsey,[The State of AI 2026](https://www.mckinsey.com/capabilities/quantumblack/our-insights/the-state-of-ai)\(reported via[Digital Chiefs](https://www.digital-chiefs.de/en/mckinsey-eight-out-of-ten-companies-accelerate-with-ai-while-ebit-remains/)\); Deloitte,[State of AI in the Enterprise 2026](https://www.deloitte.com/us/en/about/press-room/state-of-ai-report-2026.html); Capgemini Research Institute,[The multi\-year AI advantage](https://www.capgemini.com/insights/research-library/ai-perspectives-2026/); Gartner,[GenAI project abandonment prediction](https://www.gartner.com/en/newsroom/press-releases/2024-07-29-gartner-predicts-30-percent-of-generative-ai-projects-will-be-abandoned-after-proof-of-concept-by-end-of-2025)\(July 2024\) and its June 2025 agentic\-AI cancellation prediction; US Census Bureau, UK ONS, and Eurostat adoption releases as compiled by[iTechnoSol, October 2026](https://itechnosol.com/research/ai-adoption-mid-size-businesses/)\. Figures are our interpretation of these surveys; where we reconstruct rather than quote \(the waffle funnel, the causal chain\), we say so in the caption\.