8 papers
Translating in style: An open-weight alternative to GPT-4 for culturally aligned machine translation
Thomas Rietman, Hadi Mohammadi, Robert A. Bagheri
Machine translation systems often preserve meaning but systematically flatten linguistic style, a failure that is most acute when translating into non-Western languages. The RASTA…
Learning Sexism Detection Using Multi-Agent Perspectivist Preference Optimization
Hadi Mohammadi, Tina Shahedi, Robert A. Bagheri +2
When people label text for sexism, they often disagree, and not because some of them are wrong: they genuinely perceive sexism differently. Most NLP systems discard this disagreeme…
Using Human-LLM Disagreement to Improve Checklist-Based Quality Appraisal
Timo van der Kuil, Bruno Messina Coimbra, Mirjam van Zuiden +7
Systematic reviews rely on quality appraisal of included studies, a process that is time-consuming and sensitive to ambiguity in checklist criteria. Although large language models…
Language Re-generation: An investigation into information locality effects on reconstruction
Amirhossein Mohammadi, Laurence E. Frank, Albert Gatt +1
Information locality, the tendency for syntactically related words to appear close together, shapes both human language processing and language model learning. While prior work has…
Finding Meaning in Embeddings: Concept Separation Curves
Paul Keuren, Marc Ponsen, Robert Ayoub Bagheri
Sentence embedding techniques aim to encode key concepts of a sentence's meaning in a vector space. However, the majority of evaluation approaches for sentence embedding quality re…
EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Models
Hadi Mohammadi, Anastasia Giachanou, Robert A. Bagheri
We present EvalMORAAL, a transparent chain-of-thought (CoT) framework that uses two scoring methods (log-probabilities and direct ratings) plus a model-as-judge peer review to eval…
Explainability in Practice: A Survey of Explainable NLP Across Various Domains
Hadi Mohammadi, Robert A. Bagheri, Anastasia Giachanou +1
Natural Language Processing (NLP) is now embedded in critical sectors including healthcare, finance, and customer relationship management, where models such as GPT-4o, Gemini, and…
Correspondence Analysis and PMI-Based Word Embeddings: A Comparative Study
Qianqian Qi, Ayoub Bagheri, David J. Hessen +1
Popular word embedding methods such as GloVe and Word2Vec are related to the factorization of the pointwise mutual information (PMI) matrix. In this paper, we establish a formal co…