Paying more attention to snapshots of Iterative Pruning: Improving Model Compression via Ensemble Distillation

Duong H. Le, Trung-Nhan Vo, Nam Thoai

Network pruning is one of the most dominant methods for reducing the heavy inference cost of deep neural networks. Existing methods often iteratively prune networks to attain high…