BaCP: Backbone Contrastive Pruning for Preserving Representations in Extremely Sparse Neural Networks

Mohammad Haroon Khawaja, Muhammad Haseeb, Mohammad Fatim Shoaib +1

Unstructured pruning at extreme sparsity often suffers from representational collapse, causing sharp drops in accuracy. To address this, we study Backbone Contrastive Pruning (BaCP…