80 citations · 557 across the 56 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022
ELLE: Efficient Lifelong Pre-training for Emerging Data
Yujia Qin, Jiajie Zhang, Yankai Lin +4
Current pre-trained language models (PLM) are typically trained with static data, ignoring that in real-world scenarios, streaming data of various sources may continuously grow. Th…
cs.CL2022
A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models
Deming Ye, Yankai Lin, Peng Li +2
Pre-trained language models (PLMs) cannot well recall rich factual knowledge of entities exhibited in large-scale corpora, especially those rare entities. In this paper, we propose…