20 citations · 25 across the 3 of their papers we have counts for
3 papers
Towards Reliable Testing for Multiple Information Retrieval System Comparisons
David Otero, Javier Parapar, Álvaro Barreiro
Null Hypothesis Significance Testing is the \textit{de facto} tool for assessing effectiveness differences between Information Retrieval systems. Researchers use statistical tests…
Limitations of Automatic Relevance Assessments with Large Language Models for Fair and Reliable Retrieval Evaluation
David Otero, Javier Parapar, Álvaro Barreiro
Offline evaluation of search systems depends on test collections. These benchmarks provide the researchers with a corpus of documents, topics and relevance judgements indicating wh…
Using Score Distributions to Compare Statistical Significance Tests for Information Retrieval Evaluation
Javier Parapar, David E. Losada, Manuel A. Presedo-Quindimil +1
Statistical significance tests can provide evidence that the observed difference in performance between two methods is not due to chance. In Information Retrieval, some studies hav…