@oliviscusAI: OpenAI's co-founder just released his personal guide to train LLMs from scratch. It's called llm.c. No heavy setup. Jus…
Summary
OpenAI co-founder Andrej Karpathy released llm.c, an open-source guide to training LLMs from scratch with simple code that runs on any hardware, including CPUs and MacBooks, and is 7% faster than standard approaches.
View Cached Full Text
Cached at: 06/25/26, 11:17 AM
OpenAI’s co-founder just released his personal guide to train LLMs from scratch.
It’s called llm.c. No heavy setup. Just raw code that runs on almost anything.
→ Works on a regular CPU or GPU → Even runs on a MacBook → 7% faster than the standard approach
Same system that powers GPT-2 and GPT-3 training.
100% Open Source.
Similar Articles
@heygurisingh: 𝑩𝒊𝒍𝒍𝒊𝒐𝒏-𝒑𝒂𝒓𝒂𝒎𝒆𝒕𝒆𝒓 𝑳𝑳𝑴𝒔 𝒖𝒔𝒆𝒅 𝒕𝒐 𝒄𝒐𝒔𝒕 $10𝑴+ 𝒕𝒐 𝒕𝒓𝒂𝒊𝒏. Someone open sourced a repo t…
An open-source repository called train-llm-from-scratch enables training billion-parameter LLMs on a single GPU, with a configurable pipeline from raw text to inference, including dataset streaming and checkpointing, under MIT License.
@DanKornas: Building an LLM from scratch is easier when each layer has its own notebook. EveryonesLLM is a Google Colab-based tutor…
EveryonesLLM is an open-source Google Colab-based tutorial repository for building a nanoGPT-style LLM from scratch, with step-by-step chapters covering dataloading, embeddings, attention, training, and instruction tuning.
@RohOnChain: just talked to an MIT CS grad who is building the next frontier LLM. he told me this lecture by an OpenAI researcher on…
A tweet recommends a lecture by an OpenAI researcher on how LLMs are built, claiming it taught an MIT CS grad more than his entire degree.
Developing open source LLM from ground up from pretrain - rlhf(PPO/GRPO)
A developer shares progress on training a 7B parameter open source LLM from scratch using a DeepSeek architecture optimized for low VRAM, with the goal of democratizing AI development and eventually surpassing large proprietary models.
@phosphenq: This 2 hour video by Andrej Karpathy (co-founder of OpenAI) will teach you more about using LLMs than every AI tutorial…
Andrej Karpathy posted a 2-hour educational video that promises to significantly improve viewers' practical use of large language models.