Prospect Pruning: Finding Trainable Weights at Initialization using Meta-Gradients

Milad Alizadeh, Shyam A. Tailor, Luisa M Zintgraf +4

Pruning neural networks at initialization would enable us to find sparse models that retain the accuracy of the original network while consuming fewer computational resources for t…