Student Network Learning via Evolutionary Knowledge Distillation

Kangkai Zhang, Chunhui Zhang, Shikun Li +2

Knowledge distillation provides an effective way to transfer knowledge via teacher-student learning, where most existing distillation approaches apply a fixed pre-trained model as…