2 citations · 4 across the 6 of their papers we have counts for
1 paper · 1 filter
Ziwei Liu, Yongtao Wang, Xiaojie Chu
Knowledge distillation is a popular technique for transferring the knowledge from a large teacher model to a smaller student model by mimicking. However, distillation by directly a…