Accelerating CNN Training by Pruning Activation Gradients

Xucheng Ye, Pengcheng Dai, Junyu Luo +4

Sparsification is an efficient approach to accelerate CNN inference, but it is challenging to take advantage of sparsity in training procedure because the involved gradients are dy…