Propagating Asymptotic-Estimated Gradients for Low Bitwidth Quantized Neural Networks

Jun Chen, Yong Liu, Hao Zhang +2

The quantized neural networks (QNNs) can be useful for neural network acceleration and compression, but during the training process they pose a challenge: how to propagate the grad…