Tag
GuppyLM is a small ~9M-parameter language model that can be trained from scratch in 5 minutes on a single Colab notebook. It simulates a fish named Guppy talking about water, food, and light, aiming to prove that training your own language model isn't magic — it's something anyone can do.
YOON1v released Apex-2, a from-scratch decoder-only Mixture-of-Experts LLM with 3.87B total / 1.45B active parameters, pretrained on 86.5B tokens and SFT-tuned, with full code, architecture writeup, and benchmark results (HumanEval 43.9) released on Hugging Face and GitHub.