Soft Quantization: Model Compression Via Weight Coupling

Daniel T. Bernstein, Luca Di Carlo, David Schwab

We show that introducing short-range attractive couplings between the weights of a neural network during training provides a novel avenue for model quantization. These couplings ra…