Differentiable Model Compression via Pseudo Quantization Noise

Alexandre Défossez, Yossi Adi, Gabriel Synnaeve

We propose DiffQ a differentiable method for model compression for quantizing model parameters without gradient approximations (e.g., Straight Through Estimator). We suggest adding…