4 citations · 4 across the 2 of their papers we have counts for
2 papers
cs.CV2021
Student Helping Teacher: Teacher Evolution via Self-Knowledge Distillation
Zheng Li, Xiang Li, Lingfeng Yang +2
Knowledge distillation usually transfers the knowledge from a pre-trained cumbersome teacher network to a compact student network, which follows the classical teacher-teaching-stud…
cs.CV2020★ 4 cited
Online Knowledge Distillation via Multi-branch Diversity Enhancement
Zheng Li, Ying Huang, Defang Chen +3
Knowledge distillation is an effective method to transfer the knowledge from the cumbersome teacher model to the lightweight student model. Online knowledge distillation uses the e…