PRISM: Precision-Recall Informed Data-Free Knowledge Distillation via Generative Diffusion

Xuewan He, Jielei Wang, Zihan Cheng +3

Data-free knowledge distillation (DFKD) transfers knowledge from a teacher to a student without access to the real in-distribution (ID) data. While existing methods perform well on…