The Little Book of Reinforcement Learning
Summary
A concise introduction to Reinforcement Learning, from basics to applied algorithms, with PyTorch implementations and supplementary proofs.
View Cached Full Text
Cached at: 07/16/26, 10:54 PM
alxndrTL/little-book-rl
Source: https://github.com/alxndrTL/little-book-rl
The Little Book of Reinforcement Learning
This is the associated GitHub page of the Little Book of Reinforcement Learning.
This book is a short introduction to Reinforcement Learning, from the basics to applied algorithms.
In this repo, along with the book itself, you can find the supplementary material of the book. More precisely:
- under the
algos/folder, the Pytorch-based implementation of the different algorihms covered in the book, from MC to PPO. - under the
supplementary/folder, you can find detailed explanations and rigorous proofs for the dynamic programming algorithms briefly covered in the book. This is a document I wrote in 2021.
More material is subject to be added along the way in this repo.
You can print one for youself here.
Versions of the book :
- V1 (June 2026)
The book is distributed under a non-commercial Creative Commons license (CC BY-SA 4.0).
Similar Articles
@yashetal: https://github.com/alxndrTL/little-book-rl… The tiny book RL is also available here for community with its supplement m…
The Little Book of Reinforcement Learning, a concise introduction to RL with PyTorch implementations and supplementary material, has been shared on GitHub by Alexandre TL.
@Xudong07452910: Want to get started with 'Reinforcement Learning'? The biggest fear is learning a bunch of formulas and still not knowing how it actually runs. Recently I came across a very suitable introductory textbook: 'The Little Book of Reinforcement Learning'. Its advantage is that it's short, but it doesn't stop at the conceptual level. From basic RL…
Recommend 'The Little Book of Reinforcement Learning' as an introductory textbook for reinforcement learning. It's short but covers fundamentals to algorithms, and comes with PyTorch implementations and supplementary derivations, suitable for understanding core RL concepts.
@_rohit_tiwari_: Reinforcement Learning Course A structured learning path to understand and apply RL. https://github.com/upb-lea/reinfor…
A structured reinforcement learning course with lecture notes, tutorial tasks, and videos, shared as open-source materials from Paderborn University and University of Siegen.
@loganthorneloe: This is the best way to work through 'Attention Is All You Need'. It helps you understand the foundational concepts by …
A tweet recommending The Annotated Transformer as a resource for software engineers to understand the foundational concepts of the Attention Is All You Need paper by building it in PyTorch.
@NFTCPS: Want to master Reinforcement Learning? Keep dreaming, bro. Online courses just teach you how to call APIs, leaving you utterly confused after finishing. Reading papers? Mountains of formulas will scare you off instantly. Trying to systematically understand the principles? The barrier to entry feels like climbing to heaven, and the learning path is as tangled as a maze. Recently, I stumbled upon an open-source book, 'Mathematical Foundations of Reinforcement Learning,' that pierces right through this fog. It provides a crystal-clear roadmap: starting from mathematics…
Introduces an open-source book, 'Mathematical Foundations of Reinforcement Learning,' which offers a rigorous yet accessible mathematical approach to RL, using grid world examples to clarify algorithmic logic.