6 papers
CIR at iKAT SCAI 2026: Exploring Clarification Need Prediction in Agentic Conversational Search
Nolwenn Bernard, Jüri Keller, Philipp Schaer
This paper presents the participation of the Cologne Information Retrieval group in the iKAT SCAI 2026 shared task. We use an agentic conversational search system, equipped with to…
Formalized Information Needs Improve Large-Language-Model Relevance Judgments
Jüri Keller, Maik Fröbe, Björn Engelmann +4
Cranfield-style retrieval evaluations with too few or too many relevant documents or with low inter-assessor agreement on relevance can reduce the reliability of observations. In e…
LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +11
The LongEval lab focuses on the evaluation of information retrieval systems over time. Two datasets are provided that capture evolving search scenarios with changing documents, que…
Simplified Longitudinal Retrieval Experiments: A Case Study on Query Expansion and Document Boosting
Jüri Keller, Maik Fröbe, Gijs Hendriksen +3
The longitudinal evaluation of retrieval systems aims to capture how information needs and documents evolve over time. However, classical Cranfield-style retrieval evaluations only…
LongEval at CLEF 2025: Longitudinal Evaluation of IR Model Performance
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +10
This paper presents the third edition of the LongEval Lab, part of the CLEF 2025 conference, which continues to explore the challenges of temporal persistence in Information Retrie…
Counterfactual Query Rewriting to Use Historical Relevance Feedback
Jüri Keller, Maik Fröbe, Gijs Hendriksen +4
When a retrieval system receives a query it has encountered before, previous relevance feedback, such as clicks or explicit judgments can help to improve retrieval results. However…