85 citations · 204 across the 23 of their papers we have counts for
Showing 2020 · cs.CLShow all
3 papers · 2 filters
cs.CL2020★ 1 cited
AutoADR: Automatic Model Design for Ad Relevance
Yiren Chen, Yaming Yang, Hong Sun +7
Large-scale pre-trained models have attracted extensive attention in the research community and shown promising results on various tasks of natural language processing. However, th…
cs.CL2020★ 19 cited
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression
Yihuan Mao, Yujing Wang, Chufan Wu +6
BERT is a cutting-edge language representation model pre-trained by a large corpus, which achieves superior performances on various natural language understanding tasks. However, a…
cs.CL2020★ 9 cited
Improving BERT with Self-Supervised Attention
Yiren Chen, Xiaoyu Kou, Jiangang Bai +1
One of the most popular paradigms of applying large pre-trained NLP models such as BERT is to fine-tune it on a smaller dataset. However, one challenge remains as the fine-tuned mo…