Generalization of Silver Stepsize Schedule to Stochastic Optimization

Luwei Bai, Yang Zeng, Baoyu Zhou

This work introduces a two-step stepsize schedule for stochastic gradient methods minimizing smooth strongly convex functions. We consider the setting where only stochastic gradien…