@aakashgupta: Karpathy told Dwarkesh that a 1 billion parameter model, trained on clean data, could hit the intelligence of today's 1…
Summary
Andrej Karpathy claimed to Dwarkesh Patel that a 1B-parameter model trained on ultra-clean data could match today's 1.8T-parameter frontier models, implying 1,800× effective compression.
View Cached Full Text
Cached at: 04/22/26, 11:28 AM
Karpathy told Dwarkesh that a 1 billion parameter model, trained on clean data, could hit the intelligence of today’s 1.8 trillion parameter frontier. That is a 1,800x compression claim. The math behind it is more defensible than it sounds. When researchers at frontier labs
Similar Articles
@draecomino: Cerebras sets a new record: a one trillion parameter model @ 1,000 tokens/s
Cerebras announces it is running Kimi K2.6, a trillion parameter model, at approximately 1,000 tokens per second in enterprise trials, claiming the fastest frontier model performance ever measured by Artificial Analysis.
A 4b model is now beating 30b ones at web research and the reason is not size
A 4 billion parameter open model from the Apodex family outperforms 30 billion parameter models on web research benchmarks, attributed to careful training data and self-verification techniques rather than raw scale, suggesting a more democratic trajectory for AI capability.
@che_shr_cat: 1/ Parameter scale is a brute-force crutch. What if a 35B model could beat a 1,000B model simply by scaling its search …
Explores whether a 35B parameter model could surpass a 1000B model by scaling its search horizon at test time, using structured process feedback rather than brute-force parameter scaling.
@eliebakouch: very nice release by @OpenAI! a 50M active, 1.5B total gpt-oss arch MoE, to filter private information from trillion sc…
OpenAI released a 1.5B-parameter MoE model with only 50M active parameters that can filter private data from trillion-token datasets while maintaining 128k context length.
@alex_verem: a team of researchers just proved you don't need a bigger model, you need a smarter plan researchers from Tsinghua and …
Researchers from Tsinghua and South China University of Technology introduced Atomic Task Graph (ATG), a framework that enables 7B-8B open-source models to surpass GPT-4 on complex agent benchmarks without fine-tuning, by using directed graph-based planning and internal simulation to drastically reduce hallucination rates.