On a continuous time model of gradient descent dynamics and instability in deep learning

Mihaela Rosca, Yan Wu, Chongli Qin +1

The recipe behind the success of deep learning has been the combination of neural networks and gradient-based optimization. Understanding the behavior of gradient descent however,…