IFNSO: Iteration-Free Newton-Schulz Orthogonalization
arXiv:2602.02500v3 Announce Type: replace Abstract: The Newton-Schulz (NS) iteration has become a key technique for orthogonalization in optimizers such as Muon and for optimization on the Stiefel manifold. Despite its effectiveness, the conventional NS iteration incurs significant computational overhead due…
