7 papers · 1 filter
Learning Sexism Detection Using Multi-Agent Perspectivist Preference Optimization
Hadi Mohammadi, Tina Shahedi, Robert A. Bagheri +2
When people label text for sexism, they often disagree, and not because some of them are wrong: they genuinely perceive sexism differently. Most NLP systems discard this disagreeme…
Using Human-LLM Disagreement to Improve Checklist-Based Quality Appraisal
Timo van der Kuil, Bruno Messina Coimbra, Mirjam van Zuiden +7
Systematic reviews rely on quality appraisal of included studies, a process that is time-consuming and sensitive to ambiguity in checklist criteria. Although large language models…
Language Re-generation: An investigation into information locality effects on reconstruction
Amirhossein Mohammadi, Laurence E. Frank, Albert Gatt +1
Information locality, the tendency for syntactically related words to appear close together, shapes both human language processing and language model learning. While prior work has…
Finding Meaning in Embeddings: Concept Separation Curves
Paul Keuren, Marc Ponsen, Robert Ayoub Bagheri
Sentence embedding techniques aim to encode key concepts of a sentence's meaning in a vector space. However, the majority of evaluation approaches for sentence embedding quality re…
EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Models
Hadi Mohammadi, Anastasia Giachanou, Robert A. Bagheri
We present EvalMORAAL, a transparent chain-of-thought (CoT) framework that uses two scoring methods (log-probabilities and direct ratings) plus a model-as-judge peer review to eval…
Explainability in Practice: A Survey of Explainable NLP Across Various Domains
Hadi Mohammadi, Robert A. Bagheri, Anastasia Giachanou +1
Natural Language Processing (NLP) is now embedded in critical sectors including healthcare, finance, and customer relationship management, where models such as GPT-4o, Gemini, and…