27 citations · 105 across the 20 of their papers we have counts for
6 papers · 1 filter
LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +11
The LongEval lab focuses on the evaluation of information retrieval systems over time. Two datasets are provided that capture evolving search scenarios with changing documents, que…
LongEval at CLEF 2025: Longitudinal Evaluation of IR Model Performance
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +10
This paper presents the third edition of the LongEval Lab, part of the CLEF 2025 conference, which continues to explore the challenges of temporal persistence in Information Retrie…
Outcome-based Evaluation of Systematic Review Automation
Wojciech Kusa, Guido Zuccon, Petr Knoth +1
Current methods of evaluating search strategies and automated citation screening for systematic literature reviews typically rely on counting the number of relevant and not relevan…
Automation of Citation Screening for Systematic Literature Reviews using Neural Networks: A Replicability Study
Wojciech Kusa, Allan Hanbury, Petr Knoth
In the process of Systematic Literature Review, citation screening is estimated to be one of the most time-consuming steps. Multiple approaches to automate it using various machine…
Online Evaluations for Everyone: Mr. DLib's Living Lab for Scholarly Recommendations
Joeran Beel, Andrew Collins, Oliver Kopp +2
We introduce the first 'living lab' for scholarly recommender systems. This lab allows recommender-system researchers to conduct online evaluations of their novel algorithms for sc…
Simple Yet Effective Methods for Large-Scale Scholarly Publication Ranking
Drahomira Herrmannova, Petr Knoth
With the growing amount of published research, automatic evaluation of scholarly publications is becoming an important task. In this paper we address this problem and present a sim…