Why Do Masked Neural Language Models Still Need Common Sense Knowledge?

Sunjae Kwon, Cheongwoong Kang, Jiyeon Han +1

Currently, contextualized word representations are learned by intricate neural network models, such as masked neural language models (MNLMs). The new representations significantly…