anytime-training

Tag

Cards List
#anytime-training

Anytime Training with Schedule-Free Spectral Optimization

arXiv cs.LG · 2026-05-25 Cached

This paper introduces SF-NorMuon, a schedule-free spectral optimizer that matches or exceeds tuned AdamW on language models up to 772M parameters, with theoretical guarantees for stationarity and long-horizon stability.

0 favorites 0 likes
← Back to home

Submit Feedback