What Matters In The Structured Pruning of Generative Language Models?

Michael Santacroce, Zixin Wen, Yelong Shen +1

Auto-regressive large language models such as GPT-3 require enormous computational resources to use. Traditionally, structured pruning methods are employed to reduce resource usage…