167 citations · 338 across the 14 of their papers we have counts for
Showing cs.CLShow all
3 papers · 1 filter
cs.CL2022
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency
Yanyang Li, Fuli Luo, Runxin Xu +3
Structured pruning has been extensively studied on monolingual pre-trained language models and is yet to be fully evaluated on their multilingual counterparts. This work investigat…
cs.CL2020★ 5 cited
Robust Dialogue Utterance Rewriting as Sequence Tagging
Jie Hao, Linfeng Song, Liwei Wang +3
The task of dialogue rewriting aims to reconstruct the latest dialogue utterance by copying the missing content from the dialogue context. Until now, the existing models for this t…
cs.CL2020★ 11 cited
MC-BERT: Efficient Language Pre-Training via a Meta Controller
Zhenhui Xu, Linyuan Gong, Guolin Ke +5
Pre-trained contextual representations (e.g., BERT) have become the foundation to achieve state-of-the-art results on many NLP tasks. However, large-scale pre-training is computati…