2 papers
cs.CV2023
Customizing Synthetic Data for Data-Free Student Learning
Shiya Luo, Defang Chen, Can Wang
Data-free knowledge distillation (DFKD) aims to obtain a lightweight student model without original training data. Existing works generally synthesize data from the pre-trained tea…
cs.LG2022
Knowledge Distillation with Deep Supervision
Shiya Luo, Defang Chen, Can Wang
Knowledge distillation aims to enhance the performance of a lightweight student model by exploiting the knowledge from a pre-trained cumbersome teacher model. However, in the tradi…