@timodonnell: Want to watch a 535B parameter (23B active) LLM get trained live? Follow along here https://wandb.ai/marin-community/ma…
Summary
A tweet announces the live training of a 535B parameter (23B active) large language model, with links to follow the process on Weights & Biases and GitHub.
Similar Articles
@percyliang: Marin 535B-A23B started training this week! As usual, the whole process is open. Voyage plan: pretraining (80%) + midtr…
Training of the Marin 535B-A23B AI model has begun with an open process, involving pretraining and midtraining on 18.75T tokens using GB200 NVL72 hardware over about 3 months.
@andykonwinski: i can’t stop checking in on this. the marin team is training the largest fully open model ever. 535B params (23B active…
The Marin team is training the largest fully open model with 535B parameters, providing unprecedented transparency with live tracking and open data logs.
@dlwh: It’s been a few weeks since Marin kicked off our 535B/A23B MoE hero run. So far it’s gone almost boringly well. It’s al…
Open Athena has launched a 535B/A23B MoE model training run that is proceeding as predicted, highlighting their commitment to open development and significant progress in AI scaling.
@percyliang: Marin 535B-A23B training has crossed the halfway mark! Some observations and learnings so far:
Percy Liang reports that the Marin 535B-A23B model's training has passed the halfway point, sharing observations and learnings from the large-scale run.
@timoreilly: About to go live with @mlpowered to talk about the "neuroscience of AI." https://learning.oreilly.com/live-events/crack…
Tim O’Reilly and Emmanuel Ameisen discuss AI interpretability, focusing on world models in LLMs like Claude and Anthropic's tools for steering model behavior.