On SGD's Failure in Practice: Characterizing and Overcoming Stalling

Vivak Patel

Stochastic Gradient Descent (SGD) is widely used in machine learning problems to efficiently perform empirical risk minimization, yet, in practice, SGD is known to stall before rea…