@stanfordnlp: There are two paths to learning the details (aka “tricks” or “secrets”) of successfully training state-of-the-art langu…
Summary
Stanford NLP promotes the CS336 course as a path to learning the tricks of successfully training state-of-the-art language models.
View Cached Full Text
Cached at: 05/13/26, 10:26 PM
There are two paths to learning the details (aka “tricks” or “secrets”) of successfully training state-of-the-art language models:
-
Get a job at one of the leading language model companies
-
Complete all the coursework of CS336
We’re not sure which is harder to do 🤔
Similar Articles
@stanfordnlp: The “problem” with CS336 is not the ~22 hours of videos but the larger number of hours it takes to do the assignments. …
Stanford's CS336 course on language modeling from scratch is announced, featuring intensive hands-on assignments covering tokenizers, transformers, data, and alignment.
@DanKornas: "Stanford CS229 I Machine Learning I Building Large Language Models (LLMs)" (Stanford Online), ... What you will learn:…
Stanford CS229 online course announcement covering building LLMs, deep neural networks, TensorFlow, Keras, OpenCV, and NLP with spaCy.
@tan_maty: I'm blown away by this course, a must-see for CS majors: CS336, a course that's recently become legendary in the AI community. Building large language models from scratch. This course is offered by Stanford, taught by top NLP experts Percy Liang and Tatsunori Hashim…
A thread promoting Stanford's CS336 course on building language models from scratch, taught by NLP experts Percy Liang and Tatsunori Hashimoto, emphasizing hands-on understanding.
CS336: Language Modeling from Scratch
Stanford is offering a comprehensive course, CS336, where students build a language model from scratch, covering data collection, transformer construction, training, and evaluation.
@stanfordnlp: Many roughly know how a transformer works To REALLY understand modern neural LMs—MoEs, GPU tiling, kernels, RLHF, data—…
Stanford's CS336 course on modern neural language models, covering topics like MoEs and RLHF, is being released on YouTube with a two-week delay.