loss-prediction

#loss-prediction

@percyliang: Not only do we want to train a good model, we want to know it'll be good before we even start training. About a month a…

X AI KOLs Following ↗ · 2026-05-24 Cached

The Marin team pre-registered a predicted loss of 2.252 for a 129B parameter MoE model training run, and the actual result landed at 2.234, demonstrating accurate loss prediction before training.

0 favorites 0 likes

loss-prediction

@percyliang: Not only do we want to train a good model, we want to know it'll be good before we even start training. About a month a…

Submit Feedback