@pallavishekhar_: Learn LLM internals step by step - from tokenization to attention to inference optimization - BPE - Tokenization - Tran…
Summary
A tweet promoting a resource for learning LLM internals step by step, covering tokenization, attention, and optimization techniques.
View Cached Full Text
Cached at: 06/09/26, 02:49 PM
Learn LLM internals step by step - from tokenization to attention to inference optimization
- BPE
- Tokenization
- Transformer Architecture
- Math behind Attention - Q, K, and V
- Math behind √dₖ Scaling Factor
- Causal Masking
- KV Cache
- Paged Attention
- Flash Attention
- Mixture of Experts
- Grouped Query Attention
- RoPE
- RMSNorm
- LoRA
- And many more.
Learn here:
Similar Articles
How LLMs Actually Work
An in-depth walkthrough of how modern LLMs work, covering core mechanisms from tokenization to next-token prediction, without heavy math.
@divaagurlxw: I spent last few months Learning LLM Inference. Here are the best resources I have come across. 1. 𝐅𝐨𝐮𝐧𝐝𝐚𝐭𝐢𝐨𝐧…
A tweet thread shares a curated list of resources for learning LLM inference, covering tokenization, GPU hardware, optimization techniques like quantization and speculative decoding, and inference engines such as vLLM and SGLang, followed by an Nvidia architect's talk summary.
@TheAhmadOsman: INCREDIBLE RESOURCE The MOST COMPLETE GUIDE for understanding LLMs from first principles is now available online to rea…
A comprehensive free guide explaining LLMs from first principles, covering tokens, transformers, attention, fine-tuning, and local deployment.
@CamilleRoux: Une explication bien faite du fonctionnement interne des LLMs : tokens, embeddings, positional encoding, attention, fee…
This tweet shares a well-made explanation of the internal workings of LLMs, covering tokens, embeddings, positional encoding, attention, and feed-forward networks, via a blog post by 0xkato.
How LLMs Actually Work (26 minute read)
A detailed walkthrough of how transformer-based LLMs work, covering tokenization, embeddings, attention, and next-token prediction without heavy math.