Stochastic Adaptive Gradient Descent Without Descent

Jean-François Aujol, Jérémie Bigot, Camille Castera

We introduce a new adaptive step-size strategy for convex optimization with stochastic gradient that exploits the local geometry of the objective function only by means of a first-…