Really should we pruning after model be totally trained? Pruning based on a small amount of training

Li Yue, Zhao Weibin, Shang Lin

Pre-training of models in pruning algorithms plays an important role in pruning decision-making. We find that excessive pre-training is not necessary for pruning algorithms. Accord…