The Incredible Shrinking Neural Network: New Perspectives on Learning Representations Through The Lens of Pruning

Aditya Sharma, Nikolas Wolfe, Bhiksha Raj

How much can pruning algorithms teach us about the fundamentals of learning representations in neural networks? And how much can these fundamentals help while devising new pruning…