IS-ASGD: Accelerating Asynchronous SGD using Importance Sampling

Fei Wang, Jun Ye, Weichen Li +1

Variance reduction (VR) techniques for convergence rate acceleration of stochastic gradient descent (SGD) algorithm have been developed with great efforts recently. VR's two varian…