PrUE: Distilling Knowledge from Sparse Teacher Networks

Shaopu Wang, Xiaojun Chen, Mengzhen Kou +1

Although deep neural networks have enjoyed remarkable success across a wide variety of tasks, their ever-increasing size also imposes significant overhead on deployment. To compres…