Learning effective pruning at initialization from iterative pruning

Shengkai Liu, Yaofeng Cheng, Fusheng Zha +4

Pruning at initialization (PaI) reduces training costs by removing weights before training, which becomes increasingly crucial with the growing network size. However, current PaI m…