Fantastic Weights and How to Find Them: Where to Prune in Dynamic Sparse Training

Aleksandra I. Nowak, Bram Grooten, Decebal Constantin Mocanu +1

Dynamic Sparse Training (DST) is a rapidly evolving area of research that seeks to optimize the sparse initialization of a neural network by adapting its topology during training.…