216 citations · 232 across the 2 of their papers we have counts for
3 papers
Adapting Monolingual Models: Data can be Scarce when Language Similarity is High
Wietse de Vries, Martijn Bartelds, Malvina Nissim +1
For many (minority) languages, the resources needed to train large models are not available. We investigate the performance of zero-shot transfer learning with as little data as po…
As Good as New. How to Successfully Recycle English GPT-2 to Make Models for Other Languages
Wietse de Vries, Malvina Nissim
Large generative language models have been very successful for English, but other languages lag behind, in part due to data and computational limitations. We propose a method that…
BERTje: A Dutch BERT Model
Wietse de Vries, Andreas van Cranenburgh, Arianna Bisazza +3
The transformer-based pre-trained language model BERT has helped to improve state-of-the-art performance on many natural language processing (NLP) tasks. Using the same architectur…