Automated Backend-Aware Post-Training Quantization

Ziheng Jiang, Animesh Jain, Andrew Liu +4

Quantization is a key technique to reduce the resource requirement and improve the performance of neural network deployment. However, different hardware backends such as x86 CPU, N…