Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules

Chaojun Xiao, Yuqi Luo, Wenbin Zhang +8

Pre-trained language models (PLMs) have achieved remarkable results on NLP tasks but at the expense of huge parameter sizes and the consequent computational costs. In this paper, w…