Performance Characterization of using Quantization for DNN Inference on Edge Devices: Extended Version

Hyunho Ahn, Tian Chen, Nawras Alnaasan +5

Quantization is a popular technique used in Deep Neural Networks (DNN) inference to reduce the size of models and improve the overall numerical performance by exploiting native har…