Data-free Knowledge Distillation with Diffusion Models

Xiaohua Qi, Renda Li, Long Peng +6

Recently Data-Free Knowledge Distillation (DFKD) has garnered attention and can transfer knowledge from a teacher neural network to a student neural network without requiring any a…