A Retrospective Approximation Approach for Smooth Stochastic Optimization

David Newton, Raghu Bollapragada, Raghu Pasupathy +1

Stochastic Gradient (SG) is the defacto iterative technique to solve stochastic optimization (SO) problems with a smooth (non-convex) objective $f$ and a stochastic first-order ora…