The Principles of Diffusion Models by Lai et al.: thoughts on the monograph [D]
Summary
A reviewer praises 'The Principles of Diffusion Models' by Lai et al. as an exceptional monograph that balances mathematical rigor with intuition, aimed at researchers, grad students, and practitioners, with the full text freely available on the official website.
Similar Articles
A Mathematical Introduction to Diffusion Models
This paper provides a proof-oriented introduction to diffusion models, covering Langevin dynamics, score-based models, discretization, discrete diffusion, and inference-time control, intended for graduate students.
@volokuleshov: New blog post: How to Build a Diffusion Language Model. Diffusion LLMs went from open problem to reality in 2 years (Me…
A comprehensive blog post by Volodymyr Kuleshov's Cornell group explains how to build diffusion language models, covering core techniques like masked diffusion, iterative refinement, variable-length generation, controllable generation, fast samplers, and RL post-training, using open-source models such as Mercury, Gemma Diffusion, and Nemotron Diffusion as examples.
Diffusion Language Models: An Experimental Analysis
A systematic experimental analysis evaluating eight state-of-the-art Diffusion Language Models across multiple benchmarks, analyzing trade-offs between generation quality and computational efficiency.
How To Build A Modern Diffusion Language Model
A Cornell University article/survey explaining how to build modern discrete diffusion language models, covering iterative parallel refinement, fast sampling at thousands of tokens per second, and their potential to improve scaling laws over autoregressive LLMs.
Discrete Diffusion Models: A Unified Framework from Tokenization to Generation
This paper introduces a unified conceptual framework for discrete diffusion models, analyzing their design space through tokenization, state space construction, and highlighting trade-offs in training, inference, and scaling.