3 citations · 3 across the 2 of their papers we have counts for
2 papers
cs.CV2023
Triplet Knowledge Distillation
Xijun Wang, Dongyang Liu, Meina Kan +3
In Knowledge Distillation, the teacher is generally much larger than the student, making the solution of the teacher likely to be difficult for the student to learn. To ease the mi…
cs.CV2023★ 3 cited
Function-Consistent Feature Distillation
Dongyang Liu, Meina Kan, Shiguang Shan +1
Feature distillation makes the student mimic the intermediate features of the teacher. Nearly all existing feature-distillation methods use L2 distance or its slight variants as th…