Adapting Monolingual Models: Data can be Scarce when Language Similarity is High

Wietse de Vries, Martijn Bartelds, Malvina Nissim +1

For many (minority) languages, the resources needed to train large models are not available. We investigate the performance of zero-shot transfer learning with as little data as po…