2 papers
cs.CL2025
Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement
Gavin Abercrombie, Tanvi Dinkar, Amanda Cercas Curry +2
We commonly use agreement measures to assess the utility of judgements made by human annotators in Natural Language Processing (NLP) tasks. While inter-annotator agreement is frequ…
cs.CL2025
NLP Verification: Towards a General Methodology for Certifying Robustness
Marco Casadio, Tanvi Dinkar, Ekaterina Komendantskaya +6
Machine Learning (ML) has exhibited substantial success in the field of Natural Language Processing (NLP). For example large language models have empirically proven to be capable o…