431 citations · 2.5k across the 40 of their papers we have counts for
1 paper · 2 filters
Tommaso Furlanello, Zachary C. Lipton, Michael Tschannen +2
Knowledge Distillation (KD) consists of transferring “knowledge†from one machine learning model (the teacher) to another (the student). Commonly, the teacher is a high-capacit…