Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024
ConcEPT: Concept-Enhanced Pre-Training for Language Models
Xintao Wang, Zhouhong Gu, Jiaqing Liang +3
Pre-trained language models (PLMs) have been prevailing in state-of-the-art methods for natural language processing, and knowledge-enhanced PLMs are further proposed to promote mod…
cs.CL2023
Source Prompt: Coordinated Pre-training of Language Models on Diverse Corpora from Multiple Sources
Yipei Xu, Dakuan Lu, Jiaqing Liang +7
Pre-trained language models (PLMs) have established the new paradigm in the field of NLP. For more powerful PLMs, one of the most popular and successful way is to continuously scal…