Generalization Bounds for Magnitude-Based Pruning via Sparse Matrix Sketching

Etash Kumar Guha, Prasanjit Dubey, Xiaoming Huo

In this paper, we derive a novel bound on the generalization error of Magnitude-Based pruning of overparameterized neural networks. Our work builds on the bounds in Arora et al. [2…