Winning the Lottery with Continuous Sparsification

Pedro Savarese, Hugo Silva, Michael Maire

The search for efficient, sparse deep neural network models is most prominently performed by pruning: training a dense, overparameterized network and removing parameters, usually v…