108 citations · 293 across the 20 of their papers we have counts for
21 papers
SearchLog: A Web Browser Extension for Capturing Search Logs in Laboratory Studies
Jiaman He, Riccardo Xia, Dana McKay +2
Natural search logs are valuable for studying search behavior in information seeking settings. We present SearchLog, an easy-to-install web browser extension for collecting natural…
Characterizing Personality from Eye-Tracking: The Role of Gaze and Its Absence in Interactive Search Environments
Jiaman He, Marta Micheli, Damiano Spina +3
Personality traits influence how individuals engage, behave, and make decisions during the information-seeking process. However, few studies have linked personality to observable s…
Can We Hide Machines in the Crowd? Quantifying Equivalence in LLM-in-the-loop Annotation Tasks
Jiaman He, Zikang Leng, Dana McKay +2
Many evaluations of large language models (LLMs) in text annotation focus primarily on the correctness of the output, typically comparing model-generated labels to human-annotated…
Dagstuhl Perspectives Workshop 24352 -- Conversational Agents: A Framework for Evaluation (CAFE): Manifesto
Christine Bauer, Li Chen, Nicola Ferro +19
During the workshop, we deeply discussed what CONversational Information ACcess (CONIAC) is and its unique features, proposing a world model abstracting it, and defined the Convers…
Characterising Topic Familiarity and Query Specificity Using Eye-Tracking Data
Jiaman He, Zikang Leng, Dana McKay +2
Eye-tracking data has been shown to correlate with a user's knowledge level and query formulation behaviour. While previous work has focused primarily on eye gaze fixations for att…
Multi-stage Large Language Model Pipelines Can Outperform GPT-4o in Relevance Assessment
Julian A. Schnabel, Johanne R. Trippas, Falk Scholer +1
The effectiveness of search systems is evaluated using relevance labels that indicate the usefulness of documents for specific queries and users. While obtaining these relevance la…
Can Stories Help LLMs Reason? Curating Information Space Through Narrative
Vahid Sadiri Javadi, Johanne R. Trippas, Yash Kumar Lal +1
Narratives are widely recognized as a powerful tool for structuring information and facilitating comprehension of complex ideas in various domains such as science communication. Th…
Towards Investigating Biases in Spoken Conversational Search
Sachin Pathiyan Cherumanal, Falk Scholer, Johanne R. Trippas +1
Voice-based systems like Amazon Alexa, Google Assistant, and Apple Siri, along with the growing popularity of OpenAI's ChatGPT and Microsoft's Copilot, serve diverse populations, i…
Understanding Modality Preferences in Search Clarification
Leila Tavakoli, Giovanni Castiglia, Federica Calo +3
This study is the first attempt to explore the impact of clarification question modality on user preference in search engines. We introduce the multi-modal search clarification dat…
Explainability for Transparent Conversational Information-Seeking
Weronika Łajewska, Damiano Spina, Johanne Trippas +1
The increasing reliance on digital information necessitates advancements in conversational search systems, particularly in terms of information transparency. While prior research i…
Towards Detecting and Mitigating Cognitive Bias in Spoken Conversational Search
Kaixin Ji, Sachin Pathiyan Cherumanal, Johanne R. Trippas +4
Instruments such as eye-tracking devices have contributed to understanding how users interact with screen-based search engines. However, user-system interactions in audio-only chan…
Online and Offline Evaluation in Search Clarification
Leila Tavakoli, Johanne R. Trippas, Hamed Zamani +2
The effectiveness of clarification question models in engaging users within search systems is currently constrained, casting doubt on their overall usefulness. To improve the perfo…
Walert: Putting Conversational Search Knowledge into Action by Building and Evaluating a Large Language Model-Powered Chatbot
Sachin Pathiyan Cherumanal, Lin Tian, Futoon M. Abushaqra +7
Creating and deploying customized applications is crucial for operational success and enriching user experiences in the rapidly evolving modern business world. A prominent facet of…
Social network modeling and applications, a tutorial
Lisette Espín-Noboa, Tiago Peixoto, Fariba Karimi
Social networks have been widely studied over the last century from multiple disciplines to understand societal issues such as inequality in employment rates, managerial performanc…
Imagining Future Digital Assistants at Work: A Study of Task Management Needs
Yonchanok Khaokaew, Indigo Holcombe-James, Mohammad Saiedur Rahaman +11
Digital Assistants (DAs) can support workers in the workplace and beyond. However, target user needs are not fully understood, and the functions that workers would ideally want a D…
MIMICS-Duo: Offline & Online Evaluation of Search Clarification
Leila Tavakoli, Johanne R. Trippas, Hamed Zamani +2
Asking clarification questions is an active area of research; however, resources for training and evaluating search clarification methods are not sufficient. To address this issue,…
Conversational Information Seeking
Hamed Zamani, Johanne R. Trippas, Jeff Dalton +1
Conversational information seeking (CIS) is concerned with a sequence of interactions between one or more users and an information system. Interactions in CIS are primarily based o…
Towards a Model for Spoken Conversational Search
Johanne R. Trippas, Damiano Spina, Paul Thomas +3
Conversation is the natural mode for information exchange in daily life, a spoken conversational interaction for search input and output is a logical format for information seeking…
User Intent Prediction in Information-seeking Conversations
Chen Qu, Liu Yang, Bruce Croft +3
Conversational assistants are being progressively adopted by the general population. However, they are not capable of handling complicated information-seeking tasks that involve mu…
Prosody Modifications for Question-Answering in Voice-Only Settings
Aleksandr Chuklin, Aliaksei Severyn, Johanne Trippas +3
Many popular form factors of digital assistants---such as Amazon Echo, Apple Homepod, or Google Home---enable the user to hold a conversation with these systems based only on the s…
Analyzing and Characterizing User Intent in Information-seeking Conversations
Chen Qu, Liu Yang, W. Bruce Croft +3
Understanding and characterizing how people interact in information-seeking conversations is crucial in developing conversational search systems. In this paper, we introduce a new…