orthogonal-transformations

The paper introduces the EΔ-MHC-Geo Transformer, a novel architecture using adaptive geodesic operations with guaranteed orthogonality via Cayley rotations and Householder reflections. It demonstrates improved long-horizon stability and norm preservation compared to existing baselines like Deep Delta Learning.