Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks

Tim Whitaker, Darrell Whitley

Pruning methods have recently grown in popularity as an effective way to reduce the size and computational complexity of deep neural networks. Large numbers of parameters can be re…