Stochastic Training of Neural Networks via Successive Convex Approximations

Simone Scardapane, Paolo Di Lorenzo

This paper proposes a new family of algorithms for training neural networks (NNs). These are based on recent developments in the field of non-convex optimization, going under the g…