Recent Advances on Neural Network Pruning at Initialization

Huan Wang, Can Qin, Yue Bai +2

Neural network pruning typically removes connections or neurons from a pretrained converged model; while a new pruning paradigm, pruning at initialization (PaI), attempts to prune…