Punching Above Precision: Small Quantized Model Distillation with Learnable Regularizer

Abdur Rehman, S M A Sharif, Md Abdur Rahaman +3

Quantization-aware training (QAT) combined with knowledge distillation (KD) is a promising strategy for compressing Artificial Intelligence (AI) models for deployment on resource-c…