NGEMM: Optimizing GEMM for Deep Learning via Compiler-based Techniques

Wenlei Bao, Li-Wen Chang, Yang Chen +4

Quantization has emerged to be an effective way to significantly boost the performance of deep neural networks (DNNs) by utilizing low-bit computations. Despite having lower numeri…