@gnjrdi: High levels of bullshitery
Summary
A tweet claims that with only 5,000 training examples, 4 hours of training, and $80, a 4B parameter model can beat a frontier model like GPT-5.6, arguing that training data is now cheap and plentiful thanks to capable coding agents.
View Cached Full Text
Cached at: 10/05/26, 01:25 PM
High levels of bullshitery
Maxime Rivest 🧙♂️🦙🐧 (@MaximeRivest): I never thought that with only 5000 training examples, 4 hours of training and 80$ I could make a 4b model beat gpt 5.6 terra.
training data is now cheap and plentiful, coding agent are now capable enough to do the work. you just need to figure out th ask you want to teach you
Similar Articles
@MaximeRivest: I never thought that with only 5000 training examples, 4 hours of training and 80$ I could make a 4b model beat gpt 5.6…
Maxime Rivest claims he fine-tuned a 4B model using just 5000 training examples, 4 hours of training, and an $80 budget to outperform GPT 5.6, arguing that cheap training data and capable coding agents now make custom model training accessible.
I think AI training is way more accessible than people realize
The author argues that AI training is now widely accessible due to cheap GPU rentals and AI-powered tools, but many people blindly use low-quality data without verification, leading to poor results and wasted resources.
@rohanpaul_ai: 100% agree. That famous Stanford report already found GPT-3.5-level inference costs has already fallen 280X in under 2 …
A discussion on how rapidly falling inference costs (280X for GPT-3.5-level in under 2 years) will lead to Jevons paradox, driving far more demand for AI and making multi-agent systems ubiquitous with cheaper open-source models.
@bllchmbrs: holy shit this article is amazing @raw_works > I cannot help but feel excited and empowered to believe that an individu…
Enthusiastic social media post highlights an article arguing that individuals can now achieve GPT-level capabilities by running many small models on cheap local hardware.
@jxmnop: If you think about it, it's pretty embarrassing that frontier labs still pretrain models. Don't they know there's a the…
A sarcastic tweet mocking frontier AI labs for still pretraining models, claiming the loss can be predicted theoretically without actually training.