Towards Optimal One Pass Large Scale Learning with Averaged Stochastic Gradient Descent

Wei Xu

For large scale learning problems, it is desirable if we can obtain the optimal model parameters by going through the data in only one pass. Polyak and Juditsky (1992) showed that…