2 papers
cs.IR2026
Query-Document Dense Vectors for LLM Relevance Judgment Bias Analysis
Samaneh Mohtadi, Gianluca Demartini
Large Language Models (LLMs) have been used as relevance assessors for Information Retrieval (IR) evaluation collection creation due to reduced cost and increased scalability as co…
cs.IR2025
The Effect of Document Summarization on LLM-Based Relevance Judgments
Samaneh Mohtadi, Kevin Roitero, Stefano Mizzaro +1
Relevance judgments are central to the evaluation of Information Retrieval (IR) systems, but obtaining them from human annotators is costly and time-consuming. Large Language Model…