ADA-GP: Accelerating DNN Training By Adaptive Gradient Prediction

Vahid Janfaza, Shantanu Mandal, Farabi Mahmud +1

Neural network training is inherently sequential where the layers finish the forward propagation in succession, followed by the calculation and back-propagation of gradients (based…