Stochastic optimization with arbitrary recurrent data sampling

William G. Powell, Hanbaek Lyu

For obtaining optimal first-order convergence guarantee for stochastic optimization, it is necessary to use a recurrent data sampling algorithm that samples every data point with s…