Nonsmooth nonconvex stochastic heavy ball

Tam Le

Motivated by the conspicuous use of momentum-based algorithms in deep learning, we study a nonsmooth nonconvex stochastic heavy ball method and show its convergence. Our approach b…