@AndrewYNg: In the fight to defend openness in AI, the Marin project is a precious demonstration of openness in model training, wit…
Summary
Andrew Ng highlights the Marin project as a valuable example of openness in AI model training, with Percy Liang announcing the start of training for Marin 535B-A23B using open code, data, and processes.
View Cached Full Text
Cached at: 08/24/26, 05:49 AM
In the fight to defend openness in AI, the Marin project is a precious demonstration of openness in model training, with open code, data, recipes, even experimental results. Releasing AI research openly used to be the norm; I’m grateful for @percyliang’s open lab approach.
Percy Liang (@percyliang): 🚢 Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtraining (20%) on 18.75T tokens on 11 x GB200 NVL72 for ~3 months (2.7e24 FLOPs). Post-training will follow. Before kicking off the run, we trained a 4-rung
Similar Articles
@percyliang: Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtr…
Training of the Marin 535B-A23B AI model has begun with an open process, involving pretraining and midtraining on 18.75T tokens using GB200 NVL72 hardware over about 3 months.
@dlwh: It’s been a few weeks since Marin kicked off our 535B/A23B MoE hero run. So far it’s gone almost boringly well. It’s al…
Open Athena has launched a 535B/A23B MoE model training run that is proceeding as predicted, highlighting their commitment to open development and significant progress in AI scaling.
@andykonwinski: i can’t stop checking in on this. the marin team is training the largest fully open model ever. 535B params (23B active…
The Marin team is training the largest fully open model with 535B parameters, providing unprecedented transparency with live tracking and open data logs.
@rohanpaul_ai: Fair point indeed from @naval : If AI companies (Anthropic/OpenAI) train on the open web, perhaps they should be requir…
Naval Ravikant suggests that AI companies trained on open web data should be required to open their models after a certain period to prevent monopolistic control and ensure fair access.
@WilliamBarrHeld: To train better open models, we need predictable scaling. Delphi is Marin’s first step: we pretrained many small models…
Marin AI researchers, led by William Barr Held, introduce Delphi, a methodology that pretrains small models to accurately predict the training outcomes of larger 25B-parameter runs. This research aims to establish predictable scaling for more efficient open-source AI model development.