Accelerating Newton-Schulz Iteration for Orthogonalization via Chebyshev-type Polynomials

Ekaterina Grishina, Matvey Smirnov, Maxim Rakhuba

The problem of computing optimal orthogonal approximation to a given matrix has attracted growing interest in machine learning. Notable applications include the recent Muon optimiz…