Learning to Reason: Temporal Saliency Distillation for Interpretable Knowledge Transfer

Nilushika Udayangani Hewa Dehigahawattage, Kishor Nandakishor, Marimuthu Palaniswami

Knowledge distillation has proven effective for model compression by transferring knowledge from a larger network called the teacher to a smaller network called the student. Curren…