172 citations · 446 across the 27 of their papers we have counts for
1 paper · 1 filter
Suraj Srinivas, Francois Fleuret
Classical distillation methods transfer representations from a "teacher" neural network to a "student" network by matching their output activations. Recent methods also match the J…