32 citations · 106 across the 21 of their papers we have counts for
5 papers · 1 filter
Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr +15
This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talk…
Replicability Measures for Longitudinal Information Retrieval Evaluation
Jüri Keller, Timo Breuer, Philipp Schaer
Information Retrieval (IR) systems are exposed to constant changes in most components. Documents are created, updated, or deleted, the information needs are changing, and even rele…
The Two Sides of the Coin: Hallucination Generation and Detection with LLMs as Evaluators for LLMs
Anh Thu Maria Bui, Saskia Felizitas Brech, Natalie Hußfeldt +5
Hallucination detection in Large Language Models (LLMs) is crucial for ensuring their reliability. This work presents our participation in the CLEF ELOQUENT HalluciGen shared task,…
Evaluation of Temporal Change in IR Test Collections
Jüri Keller, Timo Breuer, Philipp Schaer
Information retrieval systems have been evaluated using the Cranfield paradigm for many years. This paradigm allows a systematic, fair, and reproducible evaluation of different ret…
Context-Driven Interactive Query Simulations Based on Generative Large Language Models
Björn Engelmann, Timo Breuer, Jana Isabelle Friese +2
Simulating user interactions enables a more user-oriented evaluation of information retrieval (IR) systems. While user simulations are cost-efficient and reproducible, many approac…