Dynamic Data-Free Knowledge Distillation by Easy-to-Hard Learning Strategy

Jingru Li, Sheng Zhou, Liangcheng Li +3

Data-free knowledge distillation (DFKD) is a widely-used strategy for Knowledge Distillation (KD) whose training data is not available. It trains a lightweight student model with t…