The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models

Eldar Kurtic, Daniel Campos, Tuan Nguyen +5

Transformer-based language models have become a key building block for natural language processing. While these models are extremely accurate, they can be too large and computation…