spectral-whitening

Tag

Cards List
#spectral-whitening

Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR

Hugging Face Daily Papers · 2026-05-19 Cached

This paper introduces Pion, a new optimizer that replaces Muon's spectral whitening with a high-pass NS iteration to stabilize training in low-rank and low-SNR regimes, achieving improved performance in VLA and RLVR tasks.

0 favorites 0 likes
← Back to home

Submit Feedback