Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions

Junyang Cai, Khai-Nguyen Nguyen, Nishant Shrestha +5

One surprising trait of neural networks is the extent to which their connections can be pruned with little to no effect on accuracy. But when we cross a critical level of parameter…