Data-Driven Relevance Judgments for Ranking Evaluation

Nuno Moniz, Luís Torgo, João Vinagre

Ranking evaluation metrics are a fundamental element of design and improvement efforts in information retrieval. We observe that most popular metrics disregard information portraye…