1 citations · 1 across the 2 of their papers we have counts for
2 papers
cs.LG2022★ 1 cited
Robust Distillation for Worst-class Performance
Serena Wang, Harikrishna Narasimhan, Yichen Zhou +3
Knowledge distillation has proven to be an effective technique in improving the performance a student model using predictions from a teacher model. However, recent work has shown t…
cs.LG2021
Distilling Double Descent
Andrew Cotter, Aditya Krishna Menon, Harikrishna Narasimhan +3
Distillation is the technique of training a "student" model based on examples that are labeled by a separate "teacher" model, which itself is trained on a labeled dataset. The most…