@wsl8297: Want to systematically learn AI Engineering without jumping between papers, tutorials, and repos? Check out rohitg00/ai-engineering-from-scratch. This course has 10k+ stars, 435 lessons, 20 stages, covering from math foundations, neural networks...
Summary
Recommends an open-source GitHub repo called ai-engineering-from-scratch, containing 435 lessons across 20 stages, systematically covering a complete learning path for AI engineering from math foundations to Agents.
View Cached Full Text
Cached at: 05/22/26, 05:57 PM
If you want to systematically learn AI Engineering without jumping between papers, tutorials, and code repositories, check out rohitg00/ai-engineering-from-scratch. This course has already earned 10k+ stars, with 435 lessons across 20 phases, covering math fundamentals, neural networks, RAG, agents, all the way to shipping your work for others to use.
GitHub: https://github.com/rohitg00/ai-engineering-from-scratch…
What I like about it is that the roadmap is long enough—it works well as a map you can slowly fill in.
name: agent-loop
description: ReAct-style loop for any tool list
phase: 14
lesson: 01
Implement a minimal agent loop that…
``
outputs/prompt-debug-agent.md
markdown You are an agent debugger. Given the trace of an agent run, identify the step where the agent went wrong and explain why...
░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒░░░▒▒▒
Contents
Twenty phases. Click any phase to expand its lesson list.
Phase 0: Setup & Tooling — 12 lessons
Get your environment ready for everything that follows.
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | Dev Environment | Build | Python, TypeScript, Rust |
| 02 | Git & Collaboration | Learn | — |
| 03 | GPU Setup & Cloud | Build | Python |
| 04 | APIs & Keys | Build | Python, TypeScript |
| 05 | Jupyter Notebooks | Build | Python |
| 06 | Python Environments | Build | Python |
| 07 | Docker for AI | Build | Python |
| 08 | Editor Setup | Build | — |
| 09 | Data Management | Build | Python |
| 10 | Terminal & Shell | Learn | — |
| 11 | Linux for AI | Learn | — |
| 12 | Debugging & Profiling | Build | Python |
Phase 1 — Math Foundations — 22 lessons
The intuition behind every AI algorithm, through code.
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | Linear Algebra Intuition | Learn | Python, Julia |
| 02 | Vectors, Matrices & Operations | Build | Python, Julia |
| 03 | Matrix Transformations & Eigenvalues | Build | Python, Julia |
| 04 | Calculus for ML: Derivatives & Gradients | Learn | Python |
| 05 | Chain Rule & Automatic Differentiation | Build | Python |
| 06 | Probability & Distributions | Learn | Python |
| 07 | Bayes’ Theorem & Statistical Thinking | Build | Python |
| 08 | Optimization: Gradient Descent Family | Build | Python |
| 09 | Information Theory: Entropy, KL Divergence | Learn | Python |
| 10 | Dimensionality Reduction: PCA, t-SNE, UMAP | Build | Python |
| 11 | Singular Value Decomposition | Build | Python, Julia |
| 12 | Tensor Operations | Build | Python |
| 13 | Numerical Stability | Build | Python |
| 14 | Norms & Distances | Build | Python |
| 15 | Statistics for ML | Build | Python |
| 16 | Sampling Methods | Build | Python |
| 17 | Linear Systems | Build | Python |
| 18 | Convex Optimization | Build | Python |
| 19 | Complex Numbers for AI | Learn | Python |
| 20 | The Fourier Transform | Build | Python |
| 21 | Graph Theory for ML | Build | Python |
| 22 | Stochastic Processes | Learn | Python |
Phase 2 — ML Fundamentals — 18 lessons
Classical ML — still the backbone of most production AI.
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | What Is Machine Learning | Learn | Python |
| 02 | Linear Regression from Scratch | Build | Python |
| 03 | Logistic Regression & Classification | Build | Python |
| 04 | Decision Trees & Random Forests | Build | Python |
| 05 | Support Vector Machines | Build | Python |
| 06 | KNN & Distance Metrics | Build | Python |
| 07 | Unsupervised Learning: K-Means, DBSCAN | Build | Python |
| 08 | Feature Engineering & Selection | Build | Python |
| 09 | Model Evaluation: Metrics, Cross-Validation | Build | Python |
| 10 | Bias, Variance & the Learning Curve | Learn | Python |
| 11 | Ensemble Methods: Boosting, Bagging, Stacking | Build | Python |
| 12 | Hyperparameter Tuning | Build | Python |
| 13 | ML Pipelines & Experiment Tracking | Build | Python |
| 14 | Naive Bayes | Build | Python |
| 15 | Time Series Fundamentals | Build | Python |
| 16 | Anomaly Detection | Build | Python |
| 17 | Handling Imbalanced Data | Build | Python |
| 18 | Feature Selection | Build | Python |
Phase 3 — Deep Learning Core — 13 lessons
Neural networks from first principles. No frameworks until you build one.
| # | Lesson | Type | Lang |
|---|---|---|---|
| 01 | The Perceptron: Where It All Started | Build | Python |
| 02 | Multi-Layer Networks & Forward Pass | Build | Python |
| 03 | Backpropagation from Scratch | Build | Python |
| 04 | Activation Functions: ReLU, Sigmoid, GELU & Why | Build | Python |
| 05 | Loss Functions: MSE, Cross-Entropy, Contrastive | Build | Python |
| 06 | Optimizers: SGD, Momentum, Adam, AdamW | Build | Python |
| 07 | Regularization: Dropout, Weight Decay, BatchNorm | Build | Python |
| 08 | Weight Initialization & Training Stability | Build | Python |
| 09 | Learning Rate Schedules & Warmup | Build | Python |
| 10 | Build Your Own Mini Framework | Build | Python |
| 11 | Introduction to PyTorch | Build | Python |
| 12 | Introduction to JAX | Build | Python |
| 13 | Debugging Neural Networks | Build | Python |
Phase 4 — Computer Vision — 28 lessons
From pixels to understanding — image, video, 3D, VLMs, and world models.
Similar Articles
@Russell3402: A friend wanted to learn AI engineering, but I couldn't come up with a good learning path for a while. Here I recommend an open-source AI engineering learning curriculum! It aims to take you from the ground up, covering the complete AI engineering stack: from math, machine learning, deep learning, Transformers, LLMs, Agents, MCP, multi-agent…
Recommends an open-source AI engineering learning course, containing 20 stages and 503 lessons, covering from math fundamentals to production deployment, including Python and other languages, aiming to build a complete AI engineering system from scratch.
@Xudong07452910: Open-source high-quality tutorial recommendation: ai-engineering-from-scratch — A full-stack course from zero to production-grade AI engineering. This is a systematic AI engineering course built from scratch (Learn it. Build it. Ship it for others.…)
This article recommends an open-source full-stack AI engineering course called 'ai-engineering-from-scratch', containing 503 lessons covering from mathematical foundations to production deployment, with 33.6k stars.
rohitg00/ai-engineering-from-scratch
A comprehensive, free, open-source AI engineering curriculum with 428 lessons across 20 phases, covering math foundations to autonomous swarms in Python, TypeScript, Rust, and Julia.
@IndieDevHailey: This might be the hardest-core open-source AI engineering course on the internet. The GitHub trending project: ai-engineering-from-scratch has already gained 17.4k+ Stars. It's not another AI tutorial that teaches you how to call APIs; instead, it truly guides you to build AI systems from scratch.
Introduces the trending open-source AI engineering course project ai-engineering-from-scratch on GitHub, which has earned 17.4k+ Stars. It offers 435 lessons across 20 stages, covering mathematical principles to hand-built AI systems, supports multiple languages, and aims to help learners deeply understand the underlying principles of AI.
@QingQ77: A full-stack AI engineering learning path from zero to mastery, 503 lessons covering from math basics to autonomous agent clusters, fully translated into Chinese with a dedicated website.
A full-stack AI engineering learning path from zero to mastery, containing 503 lessons covering from math basics to autonomous agent clusters, with full Chinese translation and a dedicated website.