Studying the impact of magnitude pruning on contrastive learning methods

Francesco Corti, Rahim Entezari, Sara Hooker +2

We study the impact of different pruning techniques on the representation learned by deep neural networks trained with contrastive loss functions. Our work finds that at high spars…