The Role of Regularization in Shaping Weight and Node Pruning Dependency and Dynamics

Yael Ben-Guigui, Jacob Goldberger, Tammy Riklin-Raviv

The pressing need to reduce the capacity of deep neural networks has stimulated the development of network dilution methods and their analysis. While the ability of $L_1$ and $L_0$…