32 citations · 106 across the 21 of their papers we have counts for
6 papers · 1 filter
Online Information Retrieval Evaluation using the STELLA Framework
Timo Breuer, Narges Tavakolpoursaleh, Johann Schaible +3
Involving users in early phases of software development has become a common strategy as it enables developers to consider user needs from the beginning. Once a system is in product…
ir_metadata: An Extensible Metadata Schema for IR Experiments
Timo Breuer, Jüri Keller, Philipp Schaer
The information retrieval (IR) community has a strong tradition of making the computational artifacts and resources available for future reuse, allowing the validation of experimen…
Overview of LiLAS 2021 -- Living Labs for Academic Search
Philipp Schaer, Timo Breuer, Leyla Jael Castro +3
The Living Labs for Academic Search (LiLAS) lab aims to strengthen the concept of user-centric living labs for academic search. The methodological gap between real-world and lab-ba…
Evaluating Elements of Web-based Data Enrichment for Pseudo-Relevance Feedback Retrieval
Timo Breuer, Melanie Pest, Philipp Schaer
In this work, we analyze a pseudo-relevance retrieval method based on the results of web search engines. By enriching topics with text data from web search engine result pages and…
repro_eval: A Python Interface to Reproducibility Measures of System-oriented IR Experiments
Timo Breuer, Nicola Ferro, Maria Maistro +1
In this work we introduce repro_eval - a tool for reactive reproducibility studies of system-oriented information retrieval (IR) experiments. The corresponding Python package provi…
Validating Simulations of User Query Variants
Timo Breuer, Norbert Fuhr, Philipp Schaer
System-oriented IR evaluations are limited to rather abstract understandings of real user behavior. As a solution, simulating user interactions provides a cost-efficient way to sup…