Differentiable Feature Aggregation Search for Knowledge Distillation

Yushuo Guan, Pengyu Zhao, Bingxuan Wang +4

Knowledge distillation has become increasingly important in model compression. It boosts the performance of a miniaturized student network with the supervision of the output distri…