Pruning Pre-trained Language Models Without Fine-Tuning

Ting Jiang, Deqing Wang, Fuzhen Zhuang +2

To overcome the overparameterized problem in Pre-trained Language Models (PLMs), pruning is widely used as a simple and straightforward compression method by directly removing unim…