Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes

Steven Kolawole, Lucio Dery, Jean-François Kagy +3

Structured pruning is a promising approach to create smaller, faster large language models. However, existing methods typically rely on computing the gradient via backward passes,…