@_yusufknl: As someone who's been shipping LLMs since the GPT-2 days, this lecture on cross-entropy from a Stanford math grad is th…
Summary
A practitioner recommends a free 33-minute lecture on cross-entropy that reframes language models as compression rather than next-word prediction, likening it to a Stanford ML PhD qualifier.
View Cached Full Text
Cached at: 07/20/26, 09:29 AM
As someone who’s been shipping LLMs since the GPT-2 days, this lecture on cross-entropy from a Stanford math grad is the closest thing to an ML PhD qualifying exam I’ve ever seen released publicly for free.
Everyone thinks language models predict the next word. They don’t. They compress language. Once you see the math, you can’t unsee it.
33 minutes. Bookmark & watch today.
Similar Articles
@Ai_Tech_tool: Instead of watching an hour of Netflix, watch this 2 hour hour Stanford lecture will teach you more about how LLMs like…
The article promotes a Stanford lecture on the fundamentals of Large Language Models like ChatGPT and Claude, suggesting it offers valuable technical insights.
@Hesamation: 3Blue1Brown’s new video explains why every LLM is actually a compression machine. everyone describes pre-training as “n…
3Blue1Brown's new video explains that LLMs are fundamentally compression machines, linking next-token prediction to efficient encoding of human knowledge, which leads to better abstraction and reasoning.
@aiwithmayank: THE BEST EXPLANATION OF HOW LLMS ACTUALLY WORK IS A FREE STANFORD LECTURE AND IT STARTS WITH A MOUSE EATING CHEESE it's…
A tweet promotes Stanford's free CS324 course on large language models, which uses a simple example of a mouse eating cheese to explain how LLMs work, and includes interactive demos.
@RohOnChain: Don't waste 2 years learning to build LLMs like Claude & ChatGPT. Stanford just dropped a 2 hour course on how to build…
A tweet highlights Stanford's 2-hour course on building LLMs from scratch, covering tokenization, decoding, training pipelines, and architecture, noting that Anthropic pays high salaries for such expertise.
@rohanpaul_ai: Terence Tao says the math behind today’s LLMs is actually simple. Training and running them mostly uses linear algebra,…
Terence Tao states that the mathematics underlying modern LLMs is simple, using basic linear algebra and calculus, but the unpredictability of model performance across tasks remains a mystery due to the complex nature of natural language data.