32 citations · 48 across the 14 of their papers we have counts for
14 papers
CIR at iKAT SCAI 2026: Exploring Clarification Need Prediction in Agentic Conversational Search
Nolwenn Bernard, Jüri Keller, Philipp Schaer
This paper presents the participation of the Cologne Information Retrieval group in the iKAT SCAI 2026 shared task. We use an agentic conversational search system, equipped with to…
Formalized Information Needs Improve Large-Language-Model Relevance Judgments
Jüri Keller, Maik Fröbe, Björn Engelmann +4
Cranfield-style retrieval evaluations with too few or too many relevant documents or with low inter-assessor agreement on relevance can reduce the reliability of observations. In e…
LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +11
The LongEval lab focuses on the evaluation of information retrieval systems over time. Two datasets are provided that capture evolving search scenarios with changing documents, que…
Simplified Longitudinal Retrieval Experiments: A Case Study on Query Expansion and Document Boosting
Jüri Keller, Maik Fröbe, Gijs Hendriksen +3
The longitudinal evaluation of retrieval systems aims to capture how information needs and documents evolve over time. However, classical Cranfield-style retrieval evaluations only…
LongEval at CLEF 2025: Longitudinal Evaluation of IR Model Performance
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +10
This paper presents the third edition of the LongEval Lab, part of the CLEF 2025 conference, which continues to explore the challenges of temporal persistence in Information Retrie…
Counterfactual Query Rewriting to Use Historical Relevance Feedback
Jüri Keller, Maik Fröbe, Gijs Hendriksen +4
When a retrieval system receives a query it has encountered before, previous relevance feedback, such as clicks or explicit judgments can help to improve retrieval results. However…
Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr +15
This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talk…
Replicability Measures for Longitudinal Information Retrieval Evaluation
Jüri Keller, Timo Breuer, Philipp Schaer
Information Retrieval (IR) systems are exposed to constant changes in most components. Documents are created, updated, or deleted, the information needs are changing, and even rele…
Evaluation of Temporal Change in IR Test Collections
Jüri Keller, Timo Breuer, Philipp Schaer
Information retrieval systems have been evaluated using the Cranfield paradigm for many years. This paradigm allows a systematic, fair, and reproducible evaluation of different ret…
Preliminary Results of a Scientometric Analysis of the German Information Retrieval Community 2020-2023
Philipp Schaer, Svetlana Myshkina, Jüri Keller
The German Information Retrieval community is located in two different sub-fields: Information and computer science. There are no current studies that investigate these communities…
Evaluating Temporal Persistence Using Replicability Measures
Jüri Keller, Timo Breuer, Philipp Schaer
In real-world Information Retrieval (IR) experiments, the Evaluation Environment (EE) is exposed to constant change. Documents are added, removed, or updated, and the information n…
Automated Statement Extraction from Press Briefings
Jüri Keller, Meik Bittkowski, Philipp Schaer
Scientific press briefings are a valuable information source. They consist of alternating expert speeches, questions from the audience and their answers. Therefore, they can contri…
Evaluating Research Dataset Recommendations in a Living Lab
Jüri Keller, Leon Paul Mondrian Munz
The search for research datasets is as important as laborious. Due to the importance of the choice of research data in further research, this decision must be made carefully. Addit…
ir_metadata: An Extensible Metadata Schema for IR Experiments
Timo Breuer, Jüri Keller, Philipp Schaer
The information retrieval (IR) community has a strong tradition of making the computational artifacts and resources available for future reuse, allowing the validation of experimen…