When Does Stochastic Gradient Algorithm Work Well?

Lam M. Nguyen, Nam H. Nguyen, Dzung T. Phan +2

In this paper, we consider a general stochastic optimization problem which is often at the core of supervised learning, such as deep learning and linear classification. We consider…