Tag
A detailed personal survey of modern deep learning, focusing on foundation models, vision-language models, and their architectural decisions, written for those who want intuition rather than dense math.
This article provides a visual guide to the Transformer architecture in Large Language Models, covering self-attention, causal self-attention, masked multi-head attention, and the output layer with step-by-step explanations and examples.
A detailed walkthrough of how transformer-based LLMs work, covering tokenization, embeddings, attention, and next-token prediction without heavy math.
An in-depth walkthrough of how modern LLMs work, covering core mechanisms from tokenization to next-token prediction, without heavy math.
A technical exploration of ANSI escape codes, their origins in 1970s terminals, and their enduring relevance in modern CLI tools and terminal UIs.
Based on the SGLang Omni team's internal decision-making article, this post introduces the operating principles of LLM inference systems in an accessible way, starting from basic concepts such as autoregressive decoding, KV cache, and continuous batching.
A glossary from TechCrunch that defines common AI terms such as AGI, AI agents, API endpoints, and chain of thought, updated regularly as the field evolves.
KV cache stores previously computed key and value vectors during autoregressive generation, allowing models to avoid recomputing the entire sequence at each step, significantly speeding up inference at the cost of increased memory usage.
Google DeepMind chip engineer Reiner Pope delivers a comprehensive whiteboard explanation of how chips work, covering logic gates to systolic arrays and the human brain, in a free YouTube video.
A free interactive tool called Transformer Explainer runs a live GPT-2 model in the browser, visualizing the internal workings of Transformers with a Sankey diagram and live inference.
A plain-language guide explaining what AI agents are, how they differ from chatbots, their autonomous decision-making loop, and why they are reshaping industries in 2026.