9 citations · 9 across the 4 of their papers we have counts for
1 paper · 1 filter
Abhinand Balachandran, Praveen Prashant
Knowledge distillation trains a smaller student to match the outputs of a larger teacher. Feature-based methods also align intermediate representations, but this extra constraint m…