7 papers
LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +11
The LongEval lab focuses on the evaluation of information retrieval systems over time. Two datasets are provided that capture evolving search scenarios with changing documents, que…
Compare: A Framework for Scientific Comparisons
Moritz Staudinger, Wojciech Kusa, Matteo Cancellieri +3
Navigating the vast and rapidly increasing sea of academic publications to identify institutional synergies, benchmark research contributions and pinpoint key research contribution…
USRN Discovery Pilot: Increasing the Discoverability of Open Access Content Through a National Network
Petr Knoth, Paul Walk, Matteo Cancellieri +5
This paper presents the results of the USRN Discovery Pilot Project, a collaboration of SPARC, the Confederation of Open Access Repositories (COAR), CORE and Antleaf, to enhance th…
Interoperable verification and dissemination of software assets in repositories using COAR Notify
Matteo Cancellieri, Martin Docekal, David Pride +3
The discoverability, attribution, and reusability of open research software are often hindered by its obscurity within academic manuscripts. To address this, the SoFAIR project (20…
Identifying and extracting Data Access Statements from full-text academic articles
David Pride, Matteo Cancellieri, Petr Knoth
A Data Access Statement (DAS) is a formal declaration detailing how and where the underlying research data associated with a publication can be accessed. It promotes transparency,…
LongEval at CLEF 2025: Longitudinal Evaluation of IR Model Performance
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +10
This paper presents the third edition of the LongEval Lab, part of the CLEF 2025 conference, which continues to explore the challenges of temporal persistence in Information Retrie…