2 papers
cs.CL2019
Barack's Wife Hillary: Using Knowledge-Graphs for Fact-Aware Language Modeling
Robert L. Logan, Nelson F. Liu, Matthew E. Peters +2
Modeling human language requires the ability to not only generate fluent text but also encode factual knowledge. However, traditional language models are only capable of rememberin…
cs.CL2019
Linguistic Knowledge and Transferability of Contextual Representations
Nelson F. Liu, Matt Gardner, Yonatan Belinkov +2
Contextual word representations derived from large-scale neural language models are successful across a diverse set of NLP tasks, suggesting that they encode useful and transferabl…