19 citations · 59 across the 12 of their papers we have counts for
18 papers
Mapping Brains with Language Models: A Survey
Antonia Karamolegkou, Mostafa Abdou, Anders Søgaard
Over the years, many researchers have seemingly made the same observation: Brain and language model activations exhibit some structural similarities, enabling linear partial mappin…
Structural Similarities Between Language Models and Neural Response Measurements
Jiaang Li, Antonia Karamolegkou, Yova Kementchedjhieva +3
Large language models (LLMs) have complicated internal dynamics, but induce representations of words and phrases whose geometry we can study. Human language processing is also opaq…
Word Order Does Matter (And Shuffled Language Models Know It)
Vinit Ravishankar, Mostafa Abdou, Artur Kulmizev +1
Recent studies have shown that language models pretrained and/or fine-tuned on randomly permuted sentences exhibit competitive performance on GLUE, putting into question the import…
Challenges and Strategies in Cross-Cultural NLP
Daniel Hershcovich, Stella Frank, Heather Lent +11
Various efforts in the Natural Language Processing (NLP) community have been made to accommodate linguistic diversity and serve speakers of many different languages. However, it is…
Connecting Neural Response measurements & Computational Models of language: a non-comprehensive guide
Mostafa Abdou
Understanding the neural basis of language comprehension in the brain has been a long-standing goal of various scientific research programs. Recent advances in language modelling a…
Do We Still Need Automatic Speech Recognition for Spoken Language Understanding?
Lasse Borgholt, Jakob Drachmann Havtorn, Mostafa Abdou +4
Spoken language understanding (SLU) tasks are usually solved by first transcribing an utterance with automatic speech recognition (ASR) and then feeding the output to a text-based…