C2G-KD: PCA-Constrained Generator for Data-Free Knowledge Distillation

Magnus Bengtsson, Kenneth Östberg

We introduce C2G-KD, a data-free knowledge distillation framework where a class-conditional generator is trained to produce synthetic samples guided by a frozen teacher model and g…