Scalable iterative pruning of large language and vision models using block coordinate descent

Gili Rosenberg, J. Kyle Brubaker, Martin J. A. Schuetz +4

Pruning neural networks, which involves removing a fraction of their weights, can often maintain high accuracy while significantly reducing model complexity, at least up to a certa…