Training with Quantization Noise for Extreme Model Compression

Angela Fan, Pierre Stock, Benjamin Graham +4

We tackle the problem of producing compact models, maximizing their accuracy for a given model size. A standard solution is to train networks with Quantization Aware Training, wher…