A Stochastic Proximal Method for Nonsmooth Regularized Finite Sum Optimization

Dounia Lakhmiri, Dominique Orban, Andrea Lodi

We consider the problem of training a deep neural network with nonsmooth regularization to retrieve a sparse and efficient sub-structure. Our regularizer is only assumed to be lowe…