Tag
The paper introduces RODE, an optimizer that decouples radial and directional components for matrix updates, demonstrating superior performance over Muon variants in language modeling and image classification tasks.