38 citations · 48 across the 4 of their papers we have counts for
4 papers
Cross-Lingual Transfer with Target Language-Ready Task Adapters
Marinela Parović, Alan Ansell, Ivan Vulić +1
Adapters have emerged as a modular and parameter-efficient approach to (zero-shot) cross-lingual transfer. The established MAD-X framework employs separate language and task adapte…
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer
Alan Ansell, Edoardo Maria Ponti, Anna Korhonen +1
Massively multilingual Transformers (MMTs), such as mBERT and XLM-R, are widely used for cross-lingual transfer learning. While these are pretrained to represent hundreds of langua…
Survey on the Use of Typological Information in Natural Language Processing
Helen O'Horan, Yevgeni Berzak, Ivan Vulić +2
In recent years linguistic typology, which classifies the world's languages according to their functional and structural properties, has been widely used to support multilingual NL…
SimLex-999: Evaluating Semantic Models with (Genuine) Similarity Estimation
Felix Hill, Roi Reichart, Anna Korhonen
We present SimLex-999, a gold standard resource for evaluating distributional semantic models that improves on existing resources in several important ways. First, in contrast to g…