K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining

Ruiqing Yan, Lanchang Sun, Fang Wang +1

Though pre-trained language models such as Bert and XLNet, have rapidly advanced the state-of-the-art on many NLP tasks, they implicit semantics only relying on surface information…