32 citations · 65 across the 18 of their papers we have counts for
10 papers · 1 filter
Overview of LiLAS 2020 -- Living Labs for Academic Search
Philipp Schaer, Johann Schaible, Leyla Jael Garcia Castro
Academic Search is a timeless challenge that the field of Information Retrieval has been dealing with for many years. Even today, the search for academic material is a broad field…
Simulating Users in Interactive Web Table Retrieval
Björn Engelmann, Timo Breuer, Philipp Schaer
Considering the multimodal signals of search items is beneficial for retrieval effectiveness. Especially in web table retrieval (WTR) experiments, accounting for multimodal propert…
Preliminary Results of a Scientometric Analysis of the German Information Retrieval Community 2020-2023
Philipp Schaer, Svetlana Myshkina, Jüri Keller
The German Information Retrieval community is located in two different sub-fields: Information and computer science. There are no current studies that investigate these communities…
Validating Synthetic Usage Data in Living Lab Environments
Timo Breuer, Norbert Fuhr, Philipp Schaer
Evaluating retrieval performance without editorial relevance judgments is challenging, but instead, user interactions can be used as relevance signals. Living labs offer a way for…
Living Lab Evaluation for Life and Social Sciences Search Platforms -- LiLAS at CLEF 2021
Philipp Schaer, Johann Schaible, Leyla Jael Castro
Meta-evaluation studies of system performances in controlled offline evaluation campaigns, like TREC and CLEF, show a need for innovation in evaluating IR-systems. The field of aca…
Evaluating Temporal Persistence Using Replicability Measures
Jüri Keller, Timo Breuer, Philipp Schaer
In real-world Information Retrieval (IR) experiments, the Evaluation Environment (EE) is exposed to constant change. Documents are added, removed, or updated, and the information n…