Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding

Ruyao Xu, Taolin Zhang, Chengyu Wang +6

Knowledge-Enhanced Pre-trained Language Models (KEPLMs) improve the performance of various downstream NLP tasks by injecting knowledge facts from large-scale Knowledge Graphs (KGs)…