Learning Interpretation with Explainable Knowledge Distillation

Raed Alharbi, Minh N. Vu, My T. Thai

Knowledge Distillation (KD) has been considered as a key solution in model compression and acceleration in recent years. In KD, a small student model is generally trained from a la…