Syntax-Aware Language Modeling with Recurrent Neural Networks

Duncan Blythe, Alan Akbik, Roland Vollgraf

Neural language models (LMs) are typically trained using only lexical features, such as surface forms of words. In this paper, we argue this deprives the LM of crucial syntactic si…