Tag
Introduces a free small book "Virtual Memory From First Principles", focusing on explaining virtual memory principles.
Recommends the open-source ebook project 'Claude Code From Scratch', which reproduces the core architecture of Claude Code with approximately 4300 lines of code, helping to understand how coding agents work.
Project Box is a collection of projects designed for C beginners, containing 10 projects of varying difficulty, from Tic-Tac-Toe to network programming. Each project includes source code, documentation, and build configurations, helping learners master C through practice.
NanoEuler is a GPT-2-scale language model built entirely from scratch in C/CUDA without any ML libraries, including hand-written forward/backward passes, a byte-level BPE tokenizer, and training pipeline. The project is an educational artifact demonstrating the engineering behind transformer training and runs on a single RTX 4070.
Tau is an educational Python coding agent that teaches you how to build agent harnesses, with transparent architecture and tutorials.
An interactive web page that visualizes a tiny transformer with editable weights, allowing users to see how changes affect predictions in real time, aimed at helping developers understand the forward pass of an LLM.
Updated 2204-page PDF mathematics ebook covering algebra, topology, differential calculus, and optimization theory for computer science and machine learning, released by Jean Gallier and Jocelyn Quaintance.
The UC San Diego Hao AI Lab blog provides a clear explanation of DistServe's Prefill Decode Disaggregation, tracing its acceptance from 2024 to 2025 and linking to related technologies like NVIDIA Dynamo, llm-d, Ray Serve LLM, LMCache, and MoonCake, making it a great starting point for learning LLM inference.
A tweet promoting TensorTonic, a platform that allows users to practice implementing nine common activation functions (Sigmoid, ReLU, Tanh, Softmax, Leaky ReLU, GELU, Swish, ELU, SELU) from scratch, including forward pass and gradient computation.
A developer built a transformer model entirely from scratch in TypeScript, including a custom autograd engine, and released it as an open-source educational tool on GitHub.
A blog post describing a tiny compiler that demonstrates how to lower data-parallel kernels by converting for loops into vectorized loops with lanes and masks, implemented in ~180 lines of Python.
A collection of free programming notes (PDFs) for Java, Python, JavaScript, SQL, DSA, C, and C++ from GoalKicker.
Sidegent is a product that teaches users how to build AI agents through hands-on practice.
This newsletter explains 30 core agentic engineering concepts, emphasizing learning the ideas behind tools rather than chasing every new tool.
A comprehensive guide explaining the Kalman filter and its application in building smarter trading systems, including mathematical foundations and production-grade examples.
A game where you play as the operating system, managing processes, memory, and I/O events to keep the user satisfied.
A 2013 video visualizing and audibilizing 15 sorting algorithms in 6 minutes, including selection sort, quick sort, and bogo sort.
An interpreter for John McCarthy's original Lisp, written in Python, with heavily documented source code aimed at teaching the internals of Lisp.
A thread sharing links to ebooks on AI SOC Mastery (100+ pages) and Catatan AI SOC (600+ pages), including PDFs and source code, available on Google Drive.
A simplified open-source PyTorch implementation of FLUX diffusion transformers with verifiable line-by-line source mappings, designed for educational purposes.