A Survey of Knowledge Enhanced Pre-trained Language Models

Linmei Hu, Zeyi Liu, Ziwang Zhao +3

Pre-trained Language Models (PLMs) which are trained on large text corpus via self-supervised learning method, have yielded promising performance on various tasks in Natural Langua…