Mousse: Rectifying the Geometry of Muon with Curvature-Aware Preconditioning
arXiv:2603.09697v2 Announce Type: replace Abstract: Recent advances in spectral optimization, notably Muon, have demonstrated that constraining update steps to the Stiefel manifold can significantly accelerate training and improve generalization. However, Muon implicitly assumes an isotropic optimization landscape, enforcing a uniform…
