Up to 100$\times$ Faster Data-free Knowledge Distillation

Gongfan Fang, Kanya Mo, Xinchao Wang +4

Data-free knowledge distillation (DFKD) has recently been attracting increasing attention from research communities, attributed to its capability to compress a model only using syn…