8 papers
Beyond surface form: A pipeline for semantic analysis in Alzheimer's Disease detection from spontaneous speech
Dylan Phelps, Rodrigo Wilkens, Edward Gow-Smith +6
Alzheimer's Disease (AD) is a progressive neurodegenerative condition that adversely affects cognitive abilities. Language-related changes can be automatically identified through t…
Stands to Reason: Investigating the Effect of Reasoning on Idiomaticity Detection
Dylan Phelps, Rodrigo Wilkens, Edward Gow-Smith +3
The recent trend towards utilisation of reasoning models has improved the performance of Large Language Models (LLMs) across many tasks which involve logical steps. One linguistic…
SemEval-2025 Task 1: AdMIRe -- Advancing Multimodal Idiomaticity Representation
Thomas Pickard, Aline Villavicencio, Maggie Mi +3
Idiomatic expressions present a unique challenge in NLP, as their meanings are often not directly inferable from their constituent words. Despite recent advancements in Large Langu…
Sign of the Times: Evaluating the use of Large Language Models for Idiomaticity Detection
Dylan Phelps, Thomas Pickard, Maggie Mi +2
Despite the recent ubiquity of large language models and their high zero-shot prompted performance across a wide range of tasks, it is still not known how well they perform on task…
Is Less More? Quality, Quantity and Context in Idiom Processing with Natural Language Models
Agne Knietaite, Adam Allsebrook, Anton Minkov +6
Compositionality in language models presents a problem when processing idiomatic expressions, as their meaning often cannot be directly derived from their individual parts. Althoug…
Word Boundary Information Isn't Useful for Encoder Language Models
Edward Gow-Smith, Dylan Phelps, Harish Tayyar Madabushi +2
All existing transformer-based approaches to NLP using subword tokenisation algorithms encode whitespace (word boundary information) through the use of special space symbols (such…
drsphelps at SemEval-2022 Task 2: Learning idiom representations using BERTRAM
Dylan Phelps
This paper describes our system for SemEval-2022 Task 2 Multilingual Idiomaticity Detection and Sentence Embedding sub-task B. We modify a standard BERT sentence transformer by add…
Sample Efficient Approaches for Idiomaticity Detection
Dylan Phelps, Xuan-Rui Fan, Edward Gow-Smith +3
Deep neural models, in particular Transformer-based pre-trained language models, require a significant amount of data to train. This need for data tends to lead to problems when de…