Convergence of constant step stochastic gradient descent for non-smooth non-convex functions

Pascal Bianchi, Walid Hachem, Sholom Schechtman

This paper studies the asymptotic behavior of the constant step Stochastic Gradient Descent for the minimization of an unknown function F , defined as the expectation of a non conv…