Accelerated CNN Training Through Gradient Approximation

Ziheng Wang, Sree Harsha Nelaturu

Training deep convolutional neural networks such as VGG and ResNet by gradient descent is an expensive exercise requiring specialized hardware such as GPUs. Recent works have exami…