Quantization Aware Training, ERNIE and Kurtosis Regularizer: a short empirical study

Andrea Zanetti

Pre-trained language models like Ernie or Bert are currently used in many applications. These models come with a set of pre-trained weights typically obtained in unsupervised/self-…