4 papers
Learning Sexism Detection Using Multi-Agent Perspectivist Preference Optimization
Hadi Mohammadi, Tina Shahedi, Robert A. Bagheri +2
When people label text for sexism, they often disagree, and not because some of them are wrong: they genuinely perceive sexism differently. Most NLP systems discard this disagreeme…
Using Human-LLM Disagreement to Improve Checklist-Based Quality Appraisal
Timo van der Kuil, Bruno Messina Coimbra, Mirjam van Zuiden +7
Systematic reviews rely on quality appraisal of included studies, a process that is time-consuming and sensitive to ambiguity in checklist criteria. Although large language models…
Language Re-generation: An investigation into information locality effects on reconstruction
Amirhossein Mohammadi, Laurence E. Frank, Albert Gatt +1
Information locality, the tendency for syntactically related words to appear close together, shapes both human language processing and language model learning. While prior work has…
Finding Meaning in Embeddings: Concept Separation Curves
Paul Keuren, Marc Ponsen, Robert Ayoub Bagheri
Sentence embedding techniques aim to encode key concepts of a sentence's meaning in a vector space. However, the majority of evaluation approaches for sentence embedding quality re…