15 citations · 15 across the 1 of their papers we have counts for
1 paper · 1 filter
Malte Ostendorff, Georg Rehm
Most Transformer language models are primarily pretrained on English text, limiting their use for other languages. As the model sizes grow, the performance gap between English and…