On the Learning Dynamics of Deep Neural Networks

Remi Tachet, Mohammad Pezeshki, Samira Shabanian +2

While a lot of progress has been made in recent years, the dynamics of learning in deep nonlinear neural networks remain to this day largely misunderstood. In this work, we study t…