19 citations · 35 across the 6 of their papers we have counts for
13 papers · 1 filter
Word Order Does Matter (And Shuffled Language Models Know It)
Vinit Ravishankar, Mostafa Abdou, Artur Kulmizev +1
Recent studies have shown that language models pretrained and/or fine-tuned on randomly permuted sentences exhibit competitive performance on GLUE, putting into question the import…
Challenges and Strategies in Cross-Cultural NLP
Daniel Hershcovich, Stella Frank, Heather Lent +11
Various efforts in the Natural Language Processing (NLP) community have been made to accommodate linguistic diversity and serve speakers of many different languages. However, it is…
Connecting Neural Response measurements & Computational Models of language: a non-comprehensive guide
Mostafa Abdou
Understanding the neural basis of language comprehension in the brain has been a long-standing goal of various scientific research programs. Recent advances in language modelling a…
Do Language Models Know the Way to Rome?
Bastien Liétard, Mostafa Abdou, Anders Søgaard
The global geometry of language models is important for a range of applications, but language model probes tend to evaluate rather local relations, for which ground truths are easi…
Does injecting linguistic structure into language models lead to better alignment with brain recordings?
Mostafa Abdou, Ana Valeria Gonzalez, Mariya Toneva +2
Neuroscientists evaluate deep neural networks for natural language processing as possible candidate models for how language is processed in the brain. These models are often traine…
Attention Can Reflect Syntactic Structure (If You Let It)
Vinit Ravishankar, Artur Kulmizev, Mostafa Abdou +2
Since the popularization of the Transformer as a general-purpose feature encoder for NLP, many studies have attempted to decode linguistic structure from its novel multi-head atten…