9 papers
CIR at iKAT SCAI 2026: Exploring Clarification Need Prediction in Agentic Conversational Search
Nolwenn Bernard, Jüri Keller, Philipp Schaer
This paper presents the participation of the Cologne Information Retrieval group in the iKAT SCAI 2026 shared task. We use an agentic conversational search system, equipped with to…
Validating Search Query Simulations: A Taxonomy of Measures
Andreas Konstantin Kruff, Nolwenn Bernard, Philipp Schaer
Assessing the validity of user simulators when used for the evaluation of information retrieval systems remains an open question, constraining their effective use and the reliabili…
LISP -- A Rich Interaction Dataset and Loggable Interactive Search Platform
Jana Isabelle Friese, Andreas Konstantin Kruff, Philipp Schaer +2
We present a reusable dataset and accompanying infrastructure for studying human search behavior in Interactive Information Retrieval (IIR). The dataset combines detailed interacti…
LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data
Matteo Cancellieri, Alaa El-Ebshihy, Tobias Fink +11
The LongEval lab focuses on the evaluation of information retrieval systems over time. Two datasets are provided that capture evolving search scenarios with changing documents, que…
Simplified Longitudinal Retrieval Experiments: A Case Study on Query Expansion and Document Boosting
Jüri Keller, Maik Fröbe, Gijs Hendriksen +3
The longitudinal evaluation of retrieval systems aims to capture how information needs and documents evolve over time. However, classical Cranfield-style retrieval evaluations only…
Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)
Philipp Schaer, Christin Katharina Kreutz, Krisztian Balog +2
Simulations in information access (IA) have recently gained interest, as shown by various tutorials and workshops around that topic. Simulations can be key contributors to central…