27 citations · 47 across the 5 of their papers we have counts for
5 papers
Online Information Retrieval Evaluation using the STELLA Framework
Timo Breuer, Narges Tavakolpoursaleh, Johann Schaible +3
Involving users in early phases of software development has become a common strategy as it enables developers to consider user needs from the beginning. Once a system is in product…
Overview of LiLAS 2021 -- Living Labs for Academic Search
Philipp Schaer, Timo Breuer, Leyla Jael Castro +3
The Living Labs for Academic Search (LiLAS) lab aims to strengthen the concept of user-centric living labs for academic search. The methodological gap between real-world and lab-ba…
Evaluating Elements of Web-based Data Enrichment for Pseudo-Relevance Feedback Retrieval
Timo Breuer, Melanie Pest, Philipp Schaer
In this work, we analyze a pseudo-relevance retrieval method based on the results of web search engines. By enriching topics with text data from web search engine result pages and…
repro_eval: A Python Interface to Reproducibility Measures of System-oriented IR Experiments
Timo Breuer, Nicola Ferro, Maria Maistro +1
In this work we introduce repro_eval - a tool for reactive reproducibility studies of system-oriented information retrieval (IR) experiments. The corresponding Python package provi…
How to Measure the Reproducibility of System-oriented IR Experiments
Timo Breuer, Nicola Ferro, Norbert Fuhr +4
Replicability and reproducibility of experimental results are primary concerns in all the areas of science and IR is not an exception. Besides the problem of moving the field towar…