106 citations · 280 across the 17 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CV2023
Triplet Knowledge Distillation
Xijun Wang, Dongyang Liu, Meina Kan +3
In Knowledge Distillation, the teacher is generally much larger than the student, making the solution of the teacher likely to be difficult for the student to learn. To ease the mi…
cs.CV2023★ 3 cited
Function-Consistent Feature Distillation
Dongyang Liu, Meina Kan, Shiguang Shan +1
Feature distillation makes the student mimic the intermediate features of the teacher. Nearly all existing feature-distillation methods use L2 distance or its slight variants as th…