Activation Map Adaptation for Effective Knowledge Distillation

Zhiyuan Wu, Hong Qi, Yu Jiang +4

Model compression becomes a recent trend due to the requirement of deploying neural networks on embedded and mobile devices. Hence, both accuracy and efficiency are of critical imp…