Detecting Dead Weights and Units in Neural Networks

Utku Evci

Deep Neural Networks are highly over-parameterized and the size of the neural networks can be reduced significantly after training without any decrease in performance. One can clea…