Rethinking Weight Decay For Efficient Neural Network Pruning

Hugo Tessier, Vincent Gripon, Mathieu Léonardon +3

Introduced in the late 1980s for generalization purposes, pruning has now become a staple for compressing deep neural networks. Despite many innovations in recent decades, pruning…