SVRG Meets AdaGrad: Painless Variance Reduction

Benjamin Dubois-Taine, Sharan Vaswani, Reza Babanezhad +2

Variance reduction (VR) methods for finite-sum minimization typically require the knowledge of problem-dependent constants that are often unknown and difficult to estimate. To addr…