19 citations · 59 across the 12 of their papers we have counts for
5 papers · 1 filter
Do We Still Need Automatic Speech Recognition for Spoken Language Understanding?
Lasse Borgholt, Jakob Drachmann Havtorn, Mostafa Abdou +4
Spoken language understanding (SLU) tasks are usually solved by first transcribing an utterance with automatic speech recognition (ASR) and then feeding the output to a text-based…
Do Language Models Know the Way to Rome?
Bastien Liétard, Mostafa Abdou, Anders Søgaard
The global geometry of language models is important for a range of applications, but language model probes tend to evaluate rather local relations, for which ground truths are easi…
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color
Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich +3
Pretrained language models have been shown to encode relational information, such as the relations between entities or concepts in knowledge-bases -- (Paris, Capital, France). Howe…
Does injecting linguistic structure into language models lead to better alignment with brain recordings?
Mostafa Abdou, Ana Valeria Gonzalez, Mariya Toneva +2
Neuroscientists evaluate deep neural networks for natural language processing as possible candidate models for how language is processed in the brain. These models are often traine…
Attention Can Reflect Syntactic Structure (If You Let It)
Vinit Ravishankar, Artur Kulmizev, Mostafa Abdou +2
Since the popularization of the Transformer as a general-purpose feature encoder for NLP, many studies have attempted to decode linguistic structure from its novel multi-head atten…