Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank

Ethan C. Chau, Lucy H. Lin, Noah A. Smith

Pretrained multilingual contextual representations have shown great success, but due to the limits of their pretraining data, their benefits do not apply equally to all language va…