Customizing Synthetic Data for Data-Free Student Learning

Shiya Luo, Defang Chen, Can Wang

Data-free knowledge distillation (DFKD) aims to obtain a lightweight student model without original training data. Existing works generally synthesize data from the pre-trained tea…