Learning Sparse Neural Networks with Identity Layers

Mingjian Ni, Guangyao Chen, Xiawu Zheng +3

The sparsity of Deep Neural Networks is well investigated to maximize the performance and reduce the size of overparameterized networks as possible. Existing methods focus on pruni…