Multilingual Syntax-aware Language Modeling through Dependency Tree Conversion

Shunsuke Kando, Hiroshi Noji, Yusuke Miyao

Incorporating stronger syntactic biases into neural language models (LMs) is a long-standing goal, but research in this area often focuses on modeling English text, where constitue…