Enhanced Sparsification via Stimulative Training

Shengji Tang, Weihao Lin, Hancheng Ye +4

Sparsification-based pruning has been an important category in model compression. Existing methods commonly set sparsity-inducing penalty terms to suppress the importance of droppe…