1 paper · 1 filter
Wenye Lin, Yangning Li, Yifeng Ding +1
Traditional knowledge distillation adopts a two-stage training process in which a teacher model is pre-trained and then transfers the knowledge to a compact student model. To overc…