1.5k citations · 1.6k across the 10 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
cs.CL2020★ 1.5k cited
Pre-trained Models for Natural Language Processing: A Survey
Xipeng Qiu, Tianxiang Sun, Yige Xu +3
Recently, the emergence of pre-trained models (PTMs) has brought natural language processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP.…
cs.CL2020
Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation
Yige Xu, Xipeng Qiu, Ligao Zhou +1
Fine-tuning pre-trained language models like BERT has become an effective way in NLP and yields state-of-the-art results on many downstream tasks. Recent studies on adapting BERT t…