Hybrid Data-Free Knowledge Distillation

Jialiang Tang, Shuo Chen, Chen Gong

Data-free knowledge distillation aims to learn a compact student network from a pre-trained large teacher network without using the original training data of the teacher network. E…