431 citations · 857 across the 69 of their papers we have counts for
83 papers · 1 filter
Differential Privacy, Linguistic Fairness, and Training Data Influence: Impossibility and Possibility Theorems for Multilingual Language Models
Phillip Rust, Anders Søgaard
Language models such as mBERT, XLM-R, and BLOOM aim to achieve multilingual generalization or compression to facilitate transfer to a large number of (potentially unseen) languages…
Mapping Brains with Language Models: A Survey
Antonia Karamolegkou, Mostafa Abdou, Anders Søgaard
Over the years, many researchers have seemingly made the same observation: Brain and language model activations exhibit some structural similarities, enabling linear partial mappin…
Structural Similarities Between Language Models and Neural Response Measurements
Jiaang Li, Antonia Karamolegkou, Yova Kementchedjhieva +3
Large language models (LLMs) have complicated internal dynamics, but induce representations of words and phrases whose geometry we can study. Human language processing is also opaq…
Being Right for Whose Right Reasons?
Terne Sasha Thorn Jakobsen, Laura Cabello, Anders Søgaard
Explainability methods are used to benchmark the extent to which model predictions align with human rationales i.e., are 'right for the right reasons'. Previous work has failed to…
What does the Failure to Reason with "Respectively" in Zero/Few-Shot Settings Tell Us about Language Models?
Ruixiang Cui, Seolhwa Lee, Daniel Hershcovich +1
Humans can effortlessly understand the coordinate structure of sentences such as "Niels Bohr and Kurt Cobain were born in Copenhagen and Seattle, respectively". In the context of n…
Private Meeting Summarization Without Performance Loss
Seolhwa Lee, Anders Søgaard
Meeting summarization has an enormous business potential, but in addition to being a hard problem, roll-out is challenged by privacy concerns. We explore the problem of meeting sum…