activity
20182023
most citedHow to Measure the Reproducibility of System-oriented IR Experiments

27 citations · 110 across the 10 of their papers we have counts for

collaborators
Showing cs.IRShow all

9 papers · 1 filter

cs.IR2023★ 24 cited

Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education

Christine Bauer, Ben Carterette, Nicola Ferro +1

This report documents the program and the outcomes of Dagstuhl Seminar 23031 ``Frontiers of Information Access Experimentation for Research and Education'', which brought together…

cs.IR2023★ 1 cited

UNDR: User-Needs-Driven Ranking of Products in E-Commerce

Andrea Papenmeier, Daniel Hienert, Firas Sabbah +2

Online retailers often offer a vast choice of products to their customers to filter and browse through. The order in which the products are listed depends on the ranking algorithm…

cs.IR2023★ 7 cited

Dataset of Natural Language Queries for E-Commerce

Andrea Papenmeier, Dagmar Kern, Daniel Hienert +3

Shopping online is more and more frequent in our everyday life. For e-commerce search systems, understanding natural language coming through voice assistants, chatbots or from conv…

cs.IR2023★ 9 cited

Starting Conversations with Search Engines -- Interfaces that Elicit Natural Language Queries

Andrea Papenmeier, Dagmar Kern, Daniel Hienert +3

Search systems on the Web rely on user input to generate relevant results. Since early information retrieval systems, users are trained to issue keyword searches and adapt to the l…

cs.IR2022★ 24 cited

Response to Moffat's Comment on "Towards Meaningful Statements in IR Evaluation: Mapping Evaluation Measures to Interval Scales"

Marco Ferrante, Nicola Ferro, Norbert Fuhr

Moffat recently commented on our previous work. Our work focused on how laying the foundations of our evaluation methodology into the theory of measurement can improve our knowledg…

cs.IR2022

Validating Simulations of User Query Variants

Timo Breuer, Norbert Fuhr, Philipp Schaer

System-oriented IR evaluations are limited to rather abstract understandings of real user behavior. As a solution, simulating user interactions provides a cost-efficient way to sup…

cs.IR2021★ 1 cited

Towards Meaningful Statements in IR Evaluation. Mapping Evaluation Measures to Interval Scales

Marco Ferrante, Nicola Ferro, Norbert Fuhr

Recently, it was shown that most popular IR measures are not interval-scaled, implying that decades of experimental IR research used potentially improper methods, which may have pr…

cs.IR2020★ 27 cited

How to Measure the Reproducibility of System-oriented IR Experiments

Timo Breuer, Nicola Ferro, Norbert Fuhr +4

Replicability and reproducibility of experimental results are primary concerns in all the areas of science and IR is not an exception. Besides the problem of moving the field towar…

cs.IR2018★ 9 cited

Contextualised Browsing in a Digital Library's Living Lab

Zeljko Carevic, Sascha Schüller, Philipp Mayr +1

Contextualisation has proven to be effective in tailoring \linebreak search results towards the users' information need. While this is true for a basic query search, the usage of c…