14 citations · 14 across the 6 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CV2022
Generalized Knowledge Distillation via Relationship Matching
Han-Jia Ye, Su Lu, De-Chuan Zhan
The knowledge of a well-trained deep neural network (a.k.a. the "teacher") is valuable for learning similar tasks. Knowledge distillation extracts knowledge from the teacher and in…
cs.LG2022
Selective Cross-Task Distillation
Su Lu, Han-Jia Ye, De-Chuan Zhan
The outpouring of various pre-trained models empowers knowledge distillation by providing abundant teacher resources, but there lacks a developed mechanism to utilize these teacher…