Arbitrary Bit-width Network: A Joint Layer-Wise Quantization and Adaptive Inference Approach

Chen Tang, Haoyu Zhai, Kai Ouyang +3

Conventional model quantization methods use a fixed quantization scheme to different data samples, which ignores the inherent "recognition difficulty" differences between various s…