educational

LLMs-from-scratch is a GitHub repository that accompanies the book "Build a Large Language Model," providing complete code to implement GPT from scratch with PyTorch, covering the full pipeline including pretraining, fine-tuning, and RLHF. It has gained 93K+ stars and is ideal for developers who want to deeply understand the principles behind large language models.

Tiny-Lua-Compiler is an educational, self-hosting Lua 5.1 compiler and VM written in pure Lua, designed to be small enough to study but complete enough to handle real language features.

This guide explains the end-to-end inference pipeline of LLMs, serving as a mock interview resource for understanding text generation.

The article presents an elegant geometric proof for Buffon's Needle problem by extending the concept to curved 'noodles' and using a circle to determine the probability constant, avoiding complex integrals.

This article explains Behavioral Cloning, an imitation learning technique used to train policies from expert demonstrations, discussing its theoretical basis in maximum likelihood estimation and its historical applications like AlphaGo.

An open-source primer that organizes system design concepts, offers study guides, Anki flashcards, and practice interview questions to help engineers build large-scale systems and prepare for system design interviews.

This is a proof-of-concept AI-powered hedge fund that uses multiple AI agents (e.g., Warren Buffett, Ben Graham) to simulate trading decisions for educational purposes. It is an open-source project from GitHub, not intended for real trading.

A GitHub repository providing visual and simple explanations of complex system design concepts, covering topics like APIs, load balancing, HTTP, and networking.

A comprehensive, free, open-source AI engineering curriculum with 428 lessons across 20 phases, covering math foundations to autonomous swarms in Python, TypeScript, Rust, and Julia.

The repository provides open-source code to build, pretrain, and fine-tune a GPT-like large language model from scratch, serving as the official code companion to Sebastian Raschka's book of the same name.

Datawhale社区发布的开源中文教程《从零开始构建智能体》，系统性讲解AI原生智能体的理论与实践，涵盖从基础原理到自研框架HelloAgents的完整学习路径。