Energy-entropy competition and the effectiveness of stochastic gradient descent in machine learning

Yao Zhang, Andrew M. Saxe, Madhu S. Advani +1

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the…