Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data

Shuai Zheng, James T. Kwok

Variance reduction has been commonly used in stochastic optimization. It relies crucially on the assumption that the data set is finite. However, when the data are imputed with ran…