6 papers
Context-Driven Interactive Query Simulations Based on Generative Large Language Models
Björn Engelmann, Timo Breuer, Jana Isabelle Friese +2
Simulating user interactions enables a more user-oriented evaluation of information retrieval (IR) systems. While user simulations are cost-efficient and reproducible, many approac…
Validating Synthetic Usage Data in Living Lab Environments
Timo Breuer, Norbert Fuhr, Philipp Schaer
Evaluating retrieval performance without editorial relevance judgments is challenging, but instead, user interactions can be used as relevance signals. Living labs offer a way for…
UNDR: User-Needs-Driven Ranking of Products in E-Commerce
Andrea Papenmeier, Daniel Hienert, Firas Sabbah +2
Online retailers often offer a vast choice of products to their customers to filter and browse through. The order in which the products are listed depends on the ranking algorithm…
Dataset of Natural Language Queries for E-Commerce
Andrea Papenmeier, Dagmar Kern, Daniel Hienert +3
Shopping online is more and more frequent in our everyday life. For e-commerce search systems, understanding natural language coming through voice assistants, chatbots or from conv…
Starting Conversations with Search Engines -- Interfaces that Elicit Natural Language Queries
Andrea Papenmeier, Dagmar Kern, Daniel Hienert +3
Search systems on the Web rely on user input to generate relevant results. Since early information retrieval systems, users are trained to issue keyword searches and adapt to the l…
Validating Simulations of User Query Variants
Timo Breuer, Norbert Fuhr, Philipp Schaer
System-oriented IR evaluations are limited to rather abstract understandings of real user behavior. As a solution, simulating user interactions provides a cost-efficient way to sup…