25 citations · 61 across the 11 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021★ 25 cited
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey
Xiaokai Wei, Shen Wang, Dejiao Zhang +2
Pretrained Language Models (PLM) have established a new paradigm through learning informative contextualized representations on large-scale text corpus. This new paradigm has revol…
cs.CL2021★ 1 cited
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora
Xisen Jin, Dejiao Zhang, Henghui Zhu +5
Pretrained language models (PTLMs) are typically learned over a large, static corpus and further fine-tuned for various downstream tasks. However, when deployed in the real world,…
cs.LG2021★ 8 cited
Supporting Clustering with Contrastive Learning
Dejiao Zhang, Feng Nan, Xiaokai Wei +6
Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often ove…