Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation

Renrong Shao, Wei Zhang, Jun wang

Data-free knowledge distillation~(DFKD) is an effective manner to solve model compression and transmission restrictions while retaining privacy protection, which has attracted exte…