UNIQ: Uniform Noise Injection for Non-Uniform Quantization of Neural Networks

Chaim Baskin, Eli Schwartz, Evgenii Zheltonozhskii +4

We present a novel method for neural network quantization that emulates a non-uniform $k$-quantile quantizer, which adapts to the distribution of the quantized parameters. Our appr…