Improving Knowledge Distillation via Transferring Learning Ability

Long Liu, Tong Li, Hui Cheng

Existing knowledge distillation methods generally use a teacher-student approach, where the student network solely learns from a well-trained teacher. However, this approach overlo…