Convergence of Alternating Gradient Descent for Matrix Factorization

Rachel Ward, Tamara G. Kolda

We consider alternating gradient descent (AGD) with fixed step size applied to the asymmetric matrix factorization objective. We show that, for a rank-$r$ matrix $\mathbf{A} \in \m…