773 citations · 1.5k across the 36 of their papers we have counts for
Showing 2019Show all
3 papers · 1 filter
cs.CL2019★ 75 cited
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding
Yu Sun, Shuohuan Wang, Yukun Li +4
Recently, pre-trained models have achieved state-of-the-art results in various language understanding tasks, which indicates that pre-training on large-scale corpora may play a cru…
cs.CL2019★ 3 cited
RLTM: An Efficient Neural IR Framework for Long Documents
Chen Zheng, Yu Sun, Shengxian Wan +1
Deep neural networks have achieved significant improvements in information retrieval (IR). However, most existing models are computational costly and can not efficiently scale to l…
cs.CL2019★ 773 cited
ERNIE: Enhanced Representation through Knowledge Integration
Yu Sun, Shuohuan Wang, Yukun Li +7
We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration). Inspired by the masking strategy of BER…