Convergence of gradient descent for learning linear neural networks

Gabin Maxime Nguegnang, Holger Rauhut, Ulrich Terstiege

We study the convergence properties of gradient descent for training deep linear neural networks, i.e., deep matrix factorizations, by extending a previous analysis for the related…