@v0xium: I strongly recommend reading the Transformer chapter from Speech and Language Processing by Dan Jurafsky and James H. M…
Summary
Recommends the Transformer chapter from the freely available book Speech and Language Processing by Dan Jurafsky and James H. Martin, a top resource for understanding the mathematics behind LLMs, and includes a quoted explanation of LLM pre-training.
View Cached Full Text
Cached at: 07/20/26, 09:48 AM
I strongly recommend reading the Transformer chapter from Speech and Language Processing by Dan Jurafsky and James H. Martin.
The book is freely available, and is one of the best resources if you want to understand the mathematics behind LLMs. https://t.co/gfOP7yx5WU
voxium (@v0xium): Can you explain what LLM pre-training actually means?
Every modern model, including GPT, BERT, Llama, Gemma, and Qwen, exists because of one simple idea:
Learn from unlabeled data first.
In this video, I cover the fundamentals of LLM pre-training:
• What pre-training is and
Similar Articles
How LLMs Actually Work (26 minute read)
A detailed walkthrough of how transformer-based LLMs work, covering tokenization, embeddings, attention, and next-token prediction without heavy math.
@ickma2311: Efficient AI Lecture 12: Transformer and LLM This lecture is not only about how LLMs work. It also explains the buildin…
Lecture notes from an Efficient AI course covering Transformer and LLM fundamentals, including multi-head attention, positional encoding, KV cache, and the connection between model architecture and inference efficiency. The content explains how design choices in transformers affect memory, latency, and hardware efficiency.
@techNmak: This is the best way to learn how LLMs work. Interactive. 3D. Step-by-step. Covers: → Embedding → Layer Norm → Self-Att…
An interactive 3D step-by-step guide to learning how LLMs work, covering key transformer concepts like embedding, self-attention, and softmax. It recommends a visual approach over reading papers.
@TensorTonic: If you want to actually understand LLMs (not just use them), read these in order: 1. Attention Is All You Need (transfo…
A Twitter thread recommending ten foundational papers and works to understand LLMs, from the original Transformer to DPO.
@omershapira: TIL Jurafsky & Martin, the textbook I used for Computational Linguistics in undergrad many years ago (when TAU didn't o…
The third edition of the Speech and Language Processing textbook by Jurafsky and Martin was released in January 2026, featuring a clear explanation of Transformers and various updates including new chapters on ASR, TTS, and DPO.