@percyliang: A year ago, David was the only FTE on Marin. Today, thanks to Open Athena, Marin has 10 FTE. Read his post to better un…
Summary
Marin has grown from one to ten full-time employees since joining Open Athena a year ago. The team is currently in the middle of a large-scale 535B/A23B Mixture of Experts model training run.
View Cached Full Text
Cached at: 09/06/26, 02:48 PM
A year ago, David was the only FTE on Marin. Today, thanks to Open Athena, Marin has 10 FTE. Read his post to better understand the context of Marin. And David tokens are always a pleasure to read.
David Hall (@dlwh): It’s been a few weeks since Marin kicked off our 535B/A23B MoE hero run. So far it’s gone almost boringly well.
It’s also been just over a year since Marin joined Open Athena. I wrote up some thoughts about how far we’ve come, and how we got there.
Similar Articles
@dlwh: It’s been a few weeks since Marin kicked off our 535B/A23B MoE hero run. So far it’s gone almost boringly well. It’s al…
Open Athena has launched a 535B/A23B MoE model training run that is proceeding as predicted, highlighting their commitment to open development and significant progress in AI scaling.
@percyliang: Marin believes strongly in the power of the open community. There are so many datasets that have been produced, living …
Marin has built scalable infrastructure to process 25T tokens from open datasets on Hugging Face for training their 535B language model, emphasizing the power of the open community.
@percyliang: Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtr…
Training of the Marin 535B-A23B AI model has begun with an open process, involving pretraining and midtraining on 18.75T tokens using GB200 NVL72 hardware over about 3 months.
@percyliang: For the next Marin model, we are putting together a new data mix. Currently we have 18T tokens, but could use more. So …
Percy Liang announces that for the next Marin model, they are compiling a new data mix and request high-quality token data for pre-training, mid-training, and SFT.
@percyliang: Marin 535B-A23B training has crossed the halfway mark! Some observations and learnings so far:
Percy Liang reports that the Marin 535B-A23B model's training has passed the halfway point, sharing observations and learnings from the large-scale run.