@oliviscusAI: OpenAI's co-founder just released his personal guide to train LLMs from scratch. It's called llm.c. No heavy setup. Jus…
Summary
OpenAI co-founder Andrej Karpathy released llm.c, an open-source guide to training LLMs from scratch with simple code that runs on any hardware, including CPUs and MacBooks, and is 7% faster than standard approaches.
View Cached Full Text
Cached at: 06/25/26, 11:17 AM
OpenAI’s co-founder just released his personal guide to train LLMs from scratch.
It’s called llm.c. No heavy setup. Just raw code that runs on almost anything.
→ Works on a regular CPU or GPU → Even runs on a MacBook → 7% faster than the standard approach
Same system that powers GPT-2 and GPT-3 training.
100% Open Source.
Similar Articles
@0xRicker: ANDREJ KARPATHY JUST BUILT A LLM FROM SCRATCH AND OPEN-SOURCED ALL CODE And it still contains the full LLM pipeline: → …
Andrej Karpathy built an LLM from scratch and open-sourced all code, covering the full pipeline of dataset, training loop, and inference loop, continuing his work on simplifying AI education with micrograd and makemore.
@TheAhmadOsman: Wanna replace Anthropic/OpenAI? START WITH THIS The bible for running LLMs locally is now available online to read for …
A comprehensive guide to running LLMs locally across various hardware and software setups is now available online for free, covering tools like llama.cpp, vLLM, and more.
@heygurisingh: 𝑩𝒊𝒍𝒍𝒊𝒐𝒏-𝒑𝒂𝒓𝒂𝒎𝒆𝒕𝒆𝒓 𝑳𝑳𝑴𝒔 𝒖𝒔𝒆𝒅 𝒕𝒐 𝒄𝒐𝒔𝒕 $10𝑴+ 𝒕𝒐 𝒕𝒓𝒂𝒊𝒏. Someone open sourced a repo t…
An open-source repository called train-llm-from-scratch enables training billion-parameter LLMs on a single GPU, with a configurable pipeline from raw text to inference, including dataset streaming and checkpointing, under MIT License.
@DanKornas: Building an LLM from scratch is easier when each layer has its own notebook. EveryonesLLM is a Google Colab-based tutor…
EveryonesLLM is an open-source Google Colab-based tutorial repository for building a nanoGPT-style LLM from scratch, with step-by-step chapters covering dataloading, embeddings, attention, training, and instruction tuning.
@RohOnChain: just talked to an MIT CS grad who is building the next frontier LLM. he told me this lecture by an OpenAI researcher on…
A tweet recommends a lecture by an OpenAI researcher on how LLMs are built, claiming it taught an MIT CS grad more than his entire degree.