A General Family of Stochastic Proximal Gradient Methods for Deep Learning

Jihun Yun, Aurelie C. Lozano, Eunho Yang

We study the training of regularized neural networks where the regularizer can be non-smooth and non-convex. We propose a unified framework for stochastic proximal gradient descent…