Data-Augmented Quantization-Aware Knowledge Distillation

Justin Kur, Kaiqi Zhao

Quantization-aware training (QAT) and Knowledge Distillation (KD) are combined to achieve competitive performance in creating low-bit deep learning models. Existing KD and QAT work…