Is Stochastic Gradient Descent Effective? A PDE Perspective on Machine Learning processes

Davide Barbieri, Matteo Bonforte, Peio Ibarrondo

In this paper we analyze the behaviour of the stochastic gradient descent (SGD), a widely used method in supervised learning for optimizing neural network weights via a minimizatio…