32 citations · 32 across the 2 of their papers we have counts for
7 papers
Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr +15
This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talk…
Context-Driven Interactive Query Simulations Based on Generative Large Language Models
Björn Engelmann, Timo Breuer, Jana Isabelle Friese +2
Simulating user interactions enables a more user-oriented evaluation of information retrieval (IR) systems. While user simulations are cost-efficient and reproducible, many approac…
Simulating Users in Interactive Web Table Retrieval
Björn Engelmann, Timo Breuer, Philipp Schaer
Considering the multimodal signals of search items is beneficial for retrieval effectiveness. Especially in web table retrieval (WTR) experiments, accounting for multimodal propert…
Validating Synthetic Usage Data in Living Lab Environments
Timo Breuer, Norbert Fuhr, Philipp Schaer
Evaluating retrieval performance without editorial relevance judgments is challenging, but instead, user interactions can be used as relevance signals. Living labs offer a way for…
Evaluating Temporal Persistence Using Replicability Measures
Jüri Keller, Timo Breuer, Philipp Schaer
In real-world Information Retrieval (IR) experiments, the Evaluation Environment (EE) is exposed to constant change. Documents are added, removed, or updated, and the information n…
ir_metadata: An Extensible Metadata Schema for IR Experiments
Timo Breuer, Jüri Keller, Philipp Schaer
The information retrieval (IR) community has a strong tradition of making the computational artifacts and resources available for future reuse, allowing the validation of experimen…