2 citations · 5 across the 5 of their papers we have counts for
1 paper · 2 filters
Woojeong Jin, Maziar Sanjabi, Shaoliang Nie +3
To reduce a model size but retain performance, we often rely on knowledge distillation (KD) which transfers knowledge from a large "teacher" model to a smaller "student" model. How…