Pruning as Evolution: Emergent Sparsity Through Selection Dynamics in Neural Networks

Zubair Shah, Noaman Khan

Neural networks are commonly trained in highly overparameterized regimes, yet empirical evidence consistently shows that many parameters become redundant during learning. Most exis…