KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation

Mengqi Xue, Jie Song, Xinchao Wang +3

Knowledge distillation (KD) has recently emerged as an efficacious scheme for learning compact deep neural networks (DNNs). Despite the promising results achieved, the rationale th…