Knowledge distillation using unlabeled mismatched images

Mandar Kulkarni, Kalpesh Patil, Shirish Karande

Current approaches for Knowledge Distillation (KD) either directly use training data or sample from the training data distribution. In this paper, we demonstrate effectiveness of '…