Word-order typology in Multilingual BERT: A case study in subordinate-clause detection

Dmitry Nikolaev, Sebastian Padó

The capabilities and limitations of BERT and similar models are still unclear when it comes to learning syntactic abstractions, in particular across languages. In this paper, we us…