Fast Differentiable SVD on GPU via Polar Decomposition

Uliana Parkina, Askar Tsyganov, Sergei Kudriashov +2

We present a fully GPU-oriented SVD pipeline based on polar decomposition, motivated by iterative methods that rely solely on matrix multiplications, such as the Newton-Schulz iter…