lion

LionVote introduces a per-layer learning rate adaptation mechanism for the Lion optimizer, using gradient direction stability and momentum health diagnostics with a voting system. It achieves improved accuracy on ViT-Tiny/CIFAR-100 compared to standard Lion and AdamW.