@ycombinator: In 2001, @JeffDean and Sanjay Ghemawat did the math and realized Google’s entire search index would fit in RAM — then s…

X AI KOLs Timeline Events
google tpu inference-hardware ai-engineers startup-school jeff-dean napkin-math

Summary

At Startup School 2026, Google's Chief Scientist Jeff Dean recounts the napkin math that led to Google's search index fitting in RAM and the TPU development, discussing inference hardware specialization and how startups can still compete.

In 2001, @JeffDean and Sanjay Ghemawat did the math and realized Google’s entire search index would fit in RAM — then shipped it in a few days, and search got fast. In 2013, another napkin calculation showed that three minutes of daily speech recognition per user would require doubling Google’s server fleet. That one became the TPU. At Startup School 2026, Google’s Chief Scientist talks with YC’s @sdianahu through the thought experiments behind both, why inference hardware is the next specialization, and where two or three people in a room can still win. 00:07 — Are AI Models Already Junior Engineers? 01:44 — AI Systems That Improve Themselves 02:40 — The Google Search Breakthrough That Changed Everything 04:38 — AI Agents Will Run for Weeks 05:58 — The Napkin Math That Led to TPUs 09:20 — How to Find Breakthrough Ideas 10:25 — The AI Engineer's New Mental Model 12:33 — Why AI Is Really an Energy Problem 16:11 — Context Engineering Is the Next Frontier 19:46 — The Skill That Made AI Better at Optimization 22:13 — Why Long-Running Agents Fail 25:21 — Where Startups Can Still Beat Google 31:19 — How to Become an AI-Native Founder 36:36 — Question Your Biggest Assumptions 42:08 — AI That Builds Better AI 50:02 — Build Something That Truly Matters
Original Article
View Cached Full Text

Cached at: 07/30/26, 09:58 PM

In 2001, @JeffDean and Sanjay Ghemawat did the math and realized Google’s entire search index would fit in RAM — then shipped it in a few days, and search got fast.

In 2013, another napkin calculation showed that three minutes of daily speech recognition per user would require doubling Google’s server fleet. That one became the TPU.

At Startup School 2026, Google’s Chief Scientist talks with YC’s @sdianahu through the thought experiments behind both, why inference hardware is the next specialization, and where two or three people in a room can still win.

00:07 — Are AI Models Already Junior Engineers? 01:44 — AI Systems That Improve Themselves 02:40 — The Google Search Breakthrough That Changed Everything 04:38 — AI Agents Will Run for Weeks 05:58 — The Napkin Math That Led to TPUs 09:20 — How to Find Breakthrough Ideas 10:25 — The AI Engineer’s New Mental Model 12:33 — Why AI Is Really an Energy Problem 16:11 — Context Engineering Is the Next Frontier 19:46 — The Skill That Made AI Better at Optimization 22:13 — Why Long-Running Agents Fail 25:21 — Where Startups Can Still Beat Google 31:19 — How to Become an AI-Native Founder 36:36 — Question Your Biggest Assumptions 42:08 — AI That Builds Better AI 50:02 — Build Something That Truly Matters

Similar Articles