activity
20242026
most citedLimitations of Automatic Relevance Assessments with Large Language Models for Fair and Reliable Retrieval Evaluation

5 citations · 5 across the 5 of their papers we have counts for

collaborators

6 papers

cs.CL2026

Argument Structure Prediction in Online Conversations: A Comparative Study of Modeling Paradigms and Task Architectures

Siddharth Bhargava, Sara Tonelli, Patricia Martín-Rodilla +1

Argument structure prediction (ASP) constructs complete argument structures from discourse by identifying argumentative units and their relations. While recent work has explored di…

cs.IR2026

User Preference Induction with LLMs for Offline Top-N Recommendation Evaluation

David Otero, Javier Parapar

Offline evaluation is the standard methodology for comparing top-N recommender systems, yet it relies on incomplete relevance information. In most benchmark datasets, only a small…

cs.IR2026

Hybrid Pooling with LLMs via Relevance Context Learning

David Otero, Javier Parapar

High-quality relevance judgements over large query sets are essential for evaluating Information Retrieval (IR) systems, yet manual annotation remains costly and time-consuming. La…

cs.IR2026

LLM-Assisted Pseudo-Relevance Feedback

David Otero, Javier Parapar

Query expansion is a long-standing technique to mitigate vocabulary mismatch in ad hoc Information Retrieval. Pseudo-relevance feedback methods, such as RM3, estimate an expanded q…

cs.IR2025

Towards Reliable Testing for Multiple Information Retrieval System Comparisons

David Otero, Javier Parapar, Álvaro Barreiro

Null Hypothesis Significance Testing is the \textit{de facto} tool for assessing effectiveness differences between Information Retrieval systems. Researchers use statistical tests…

cs.IR2024★ 5 cited

Limitations of Automatic Relevance Assessments with Large Language Models for Fair and Reliable Retrieval Evaluation

David Otero, Javier Parapar, Álvaro Barreiro

Offline evaluation of search systems depends on test collections. These benchmarks provide the researchers with a corpus of documents, topics and relevance judgements indicating wh…