34 citations · 111 across the 25 of their papers we have counts for
8 papers · 1 filter
Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer
Marko Vidoni, Ivan Vulić, Goran Glavaš
Adapter modules, additional trainable parameters that enable efficient fine-tuning of pretrained transformers, have recently been used for language specialization of multilingual t…
AraWEAT: Multidimensional Analysis of Biases in Arabic Word Embeddings
Anne Lauscher, Rafik Takieddin, Simone Paolo Ponzetto +1
Recent work has shown that distributional word vector spaces often encode human biases like sexism or racism. In this work, we conduct an extensive analysis of biases in Arabic wor…
Probing Pretrained Language Models for Lexical Semantics
Ivan Vulić, Edoardo Maria Ponti, Robert Litschko +2
The success of large pretrained language models (LMs) such as BERT and RoBERTa has sparked interest in probing their representations, in order to unveil what types of knowledge the…
Entropic dynamics on Gibbs statistical manifolds
Pedro Pessoa, Felipe Xavier Costa, Ariel Caticha
Entropic dynamics is a framework in which the laws of dynamics are derived as an application of entropic methods of inference. Its successes include the derivation of quantum mecha…
From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers
Anne Lauscher, Vinit Ravishankar, Ivan Vulić +1
Massively multilingual transformers pretrained with language modeling objectives (e.g., mBERT, XLM-R) have become a de facto default transfer paradigm for zero-shot cross-lingual t…
Towards Instance-Level Parser Selection for Cross-Lingual Transfer of Dependency Parsers
Robert Litschko, Ivan Vulić, Željko Agić +1
Current methods of cross-lingual parser transfer focus on predicting the best parser for a low-resource target language globally, that is, "at treebank level". In this work, we pro…