Learning deep linear neural networks: Riemannian gradient flows and convergence to global minimizers

Bubacarr Bah, Holger Rauhut, Ulrich Terstiege +1

We study the convergence of gradient flows related to learning deep linear neural networks (where the activation function is the identity map) from data. In this case, the composit…