3 papers
cs.AI2024
MINDECHO: Role-Playing Language Agents for Key Opinion Leaders
Rui Xu, Dakuan Lu, Xiaoyu Tan +5
Large language models~(LLMs) have demonstrated impressive performance in various applications, among which role-playing language agents (RPLAs) have engaged a broad user base. Now,…
cs.CL2024
ConcEPT: Concept-Enhanced Pre-Training for Language Models
Xintao Wang, Zhouhong Gu, Jiaqing Liang +3
Pre-trained language models (PLMs) have been prevailing in state-of-the-art methods for natural language processing, and knowledge-enhanced PLMs are further proposed to promote mod…
cs.CL2023
Source Prompt: Coordinated Pre-training of Language Models on Diverse Corpora from Multiple Sources
Yipei Xu, Dakuan Lu, Jiaqing Liang +7
Pre-trained language models (PLMs) have established the new paradigm in the field of NLP. For more powerful PLMs, one of the most popular and successful way is to continuously scal…