XGrad: Boosting Gradient-Based Optimizers With Weight Prediction

Lei Guan, Dongsheng Li, Yanqi Shi +1

In this paper, we propose a general deep learning training framework XGrad which introduces weight prediction into the popular gradient-based optimizers to boost their convergence…