Accelerate RNN-based Training with Importance Sampling

Fei Wang, Xiaofeng Gao, Guihai Chen +1

Importance sampling (IS) as an elegant and efficient variance reduction (VR) technique for the acceleration of stochastic optimization problems has attracted many researches recent…