On the Convergence of A Family of Robust Losses for Stochastic Gradient Descent

Bo Han, Ivor W. Tsang, Ling Chen

The convergence of Stochastic Gradient Descent (SGD) using convex loss functions has been widely studied. However, vanilla SGD methods using convex losses cannot perform well with…