29 citations · 44 across the 4 of their papers we have counts for
7 papers
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks
Rochelle Choenni, Dan Garrette, Ekaterina Shutova
Large multilingual language models typically share their parameters across all languages, which enables cross-lingual task transfer, but learning can also be hindered when training…
Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?
Rochelle Choenni, Ekaterina Shutova, Robert van Rooij
In this paper, we investigate what types of stereotypical information are captured by pretrained language models. We present the first dataset comprising stereotypical attributes o…
Cross-neutralising: Probing for joint encoding of linguistic information in multilingual models
Rochelle Choenni, Ekaterina Shutova
Multilingual sentence encoders are widely used to transfer NLP models across languages. The success of this transfer is, however, dependent on the model's ability to encode the pat…
What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties
Rochelle Choenni, Ekaterina Shutova
Multilingual sentence encoders have seen much success in cross-lingual model transfer for downstream NLP tasks. Yet, we know relatively little about the properties of individual la…
Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains
Samira Abnar, Lisa Beinborn, Rochelle Choenni +1
In this paper, we define and apply representational stability analysis (ReStA), an intuitive way of analyzing neural language models. ReStA is a variant of the popular representati…
Robust Evaluation of Language-Brain Encoding Experiments
Lisa Beinborn, Samira Abnar, Rochelle Choenni
Language-brain encoding experiments evaluate the ability of language models to predict brain responses elicited by language stimuli. The evaluation scenarios for this task have not…