17 citations · 32 across the 7 of their papers we have counts for
20 papers · 1 filter
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models
Karolina Stańczak, Edoardo Ponti, Lucas Torroba Hennigen +2
The success of multilingual pre-trained models is underpinned by their ability to learn representations shared by multiple languages even in absence of any explicit supervision. Ho…
Visually Grounded Reasoning across Languages and Cultures
Fangyu Liu, Emanuele Bugliarello, Edoardo Maria Ponti +3
The design of widespread vision-and-language datasets and pre-trained encoders directly adopts, or draws inspiration from, the concepts and images of ImageNet. While one can hardly…
Towards Zero-shot Language Modeling
Edoardo Maria Ponti, Ivan Vulić, Ryan Cotterell +2
Can we construct a neural model that is inductively biased towards learning human languages? Motivated by this question, we aim at constructing an informative prior over neural wei…
Modelling Latent Translations for Cross-Lingual Transfer
Edoardo Maria Ponti, Julia Kreutzer, Ivan Vulić +1
While achieving state-of-the-art results in multiple tasks and languages, translation-based cross-lingual transfer is often overlooked in favour of massively multilingual pre-train…
SIGTYP 2021 Shared Task: Robust Spoken Language Identification
Elizabeth Salesky, Badr M. Abdullah, Sabrina J. Mielke +6
While language identification is a fundamental speech and language processing task, for many languages and language families it remains a challenging task. For many low-resource an…
Minimax and Neyman-Pearson Meta-Learning for Outlier Languages
Edoardo Maria Ponti, Rahul Aralikatte, Disha Shrivastava +2
Model-agnostic meta-learning (MAML) has been recently put forth as a strategy to learn resource-poor languages in a sample-efficient fashion. Nevertheless, the properties of these…