SWAP: Sparse Entropic Wasserstein Regression for Robust Network Pruning

Lei You, Hei Victor Cheng

This study addresses the challenge of inaccurate gradients in computing the empirical Fisher Information Matrix during neural network pruning. We introduce SWAP, a formulation of E…