108 citations · 293 across the 20 of their papers we have counts for
12 papers · 1 filter
SearchLog: A Web Browser Extension for Capturing Search Logs in Laboratory Studies
Jiaman He, Riccardo Xia, Dana McKay +2
Natural search logs are valuable for studying search behavior in information seeking settings. We present SearchLog, an easy-to-install web browser extension for collecting natural…
Can We Hide Machines in the Crowd? Quantifying Equivalence in LLM-in-the-loop Annotation Tasks
Jiaman He, Zikang Leng, Dana McKay +2
Many evaluations of large language models (LLMs) in text annotation focus primarily on the correctness of the output, typically comparing model-generated labels to human-annotated…
Characterising Topic Familiarity and Query Specificity Using Eye-Tracking Data
Jiaman He, Zikang Leng, Dana McKay +2
Eye-tracking data has been shown to correlate with a user's knowledge level and query formulation behaviour. While previous work has focused primarily on eye gaze fixations for att…
Multi-stage Large Language Model Pipelines Can Outperform GPT-4o in Relevance Assessment
Julian A. Schnabel, Johanne R. Trippas, Falk Scholer +1
The effectiveness of search systems is evaluated using relevance labels that indicate the usefulness of documents for specific queries and users. While obtaining these relevance la…
Explainability for Transparent Conversational Information-Seeking
Weronika Łajewska, Damiano Spina, Johanne Trippas +1
The increasing reliance on digital information necessitates advancements in conversational search systems, particularly in terms of information transparency. While prior research i…
Online and Offline Evaluation in Search Clarification
Leila Tavakoli, Johanne R. Trippas, Hamed Zamani +2
The effectiveness of clarification question models in engaging users within search systems is currently constrained, casting doubt on their overall usefulness. To improve the perfo…
Walert: Putting Conversational Search Knowledge into Action by Building and Evaluating a Large Language Model-Powered Chatbot
Sachin Pathiyan Cherumanal, Lin Tian, Futoon M. Abushaqra +7
Creating and deploying customized applications is crucial for operational success and enriching user experiences in the rapidly evolving modern business world. A prominent facet of…
MIMICS-Duo: Offline & Online Evaluation of Search Clarification
Leila Tavakoli, Johanne R. Trippas, Hamed Zamani +2
Asking clarification questions is an active area of research; however, resources for training and evaluating search clarification methods are not sufficient. To address this issue,…
Conversational Information Seeking
Hamed Zamani, Johanne R. Trippas, Jeff Dalton +1
Conversational information seeking (CIS) is concerned with a sequence of interactions between one or more users and an information system. Interactions in CIS are primarily based o…
Towards a Model for Spoken Conversational Search
Johanne R. Trippas, Damiano Spina, Paul Thomas +3
Conversation is the natural mode for information exchange in daily life, a spoken conversational interaction for search input and output is a logical format for information seeking…
User Intent Prediction in Information-seeking Conversations
Chen Qu, Liu Yang, Bruce Croft +3
Conversational assistants are being progressively adopted by the general population. However, they are not capable of handling complicated information-seeking tasks that involve mu…
Analyzing and Characterizing User Intent in Information-seeking Conversations
Chen Qu, Liu Yang, W. Bruce Croft +3
Understanding and characterizing how people interact in information-seeking conversations is crucial in developing conversational search systems. In this paper, we introduce a new…