Self-Supervised Quantization-Aware Knowledge Distillation

Kaiqi Zhao, Ming Zhao

Quantization-aware training (QAT) and Knowledge Distillation (KD) are combined to achieve competitive performance in creating low-bit deep learning models. However, existing works…