1 paper · 1 filter
Chen Hu, Qianxi Zhao, Xiaochen Yuan +4
The Newton-Schulz (NS) iteration has become a key technique for orthogonalization in optimizers such as Muon and for optimization on the Stiefel manifold. Despite its effectiveness…