2 papers
cs.LG2017
Accelerate RNN-based Training with Importance Sampling
Fei Wang, Xiaofeng Gao, Guihai Chen +1
Importance sampling (IS) as an elegant and efficient variance reduction (VR) technique for the acceleration of stochastic optimization problems has attracted many researches recent…
cs.DC2017
IS-ASGD: Accelerating Asynchronous SGD using Importance Sampling
Fei Wang, Jun Ye, Weichen Li +1
Variance reduction (VR) techniques for convergence rate acceleration of stochastic gradient descent (SGD) algorithm have been developed with great efforts recently. VR's two varian…