Learning Compact Neural Networks with Deep Overparameterised Multitask Learning

Shen Ren, Haosen Shi

Compact neural network offers many benefits for real-world applications. However, it is usually challenging to train the compact neural networks with small parameter sizes and low…