What if i really wanna train an AI from scratch?

Reddit r/artificial News

Summary

A personal reflection on the challenges and allure of training an AI model from scratch, highlighting the difficulties with data, hardware, and scaling, while noting that surprisingly good small models can be trained on modest hardware.

I got obsessed with this idea recently 😭 Not “build an AI app.” Not “connect GPT API.” I mean actually train a model. Like downloading datasets at 3AM, watching GPUs melt, fixing random CUDA errors for 6 hours straight, training for days just to realize the dataset was garbage 💀 Everybody online makes it sound impossible unless you have billions of dollars and a data center the size of a city. But at the same time… people are out here training surprisingly good small models from bedrooms and rented GPUs. So now I’m stuck in this weird mindset where: part of me thinks this is insanely unrealistic and the other part thinks we’re super early and nobody fully knows what’s possible yet The craziest thing is realizing the model itself is only half the battle. The REAL nightmare seems to be: collecting clean data keeping outputs consistent inference costs scaling making the AI not become completely stupid after bad training 😭 Anyone else here trying this stuff seriously instead of just wrapping APIs?
Original Article

Similar Articles

@qinzytech: https://x.com/qinzytech/status/2066585405479371092

X AI KOLs Timeline

A technical analysis of two approaches to building self-evolving AI agents: model-based (via architecture like SSMs or transformer with fast-weight updates, and training methods) and harness-based (via memory or meta harness that can rewrite itself). The author provides practical recommendations for different audiences.