ConcEPT: Concept-Enhanced Pre-Training for Language Models

Xintao Wang, Zhouhong Gu, Jiaqing Liang +3

Pre-trained language models (PLMs) have been prevailing in state-of-the-art methods for natural language processing, and knowledge-enhanced PLMs are further proposed to promote mod…