5 papers · 1 filter
Personalization and Evaluation of Conversational Information Access
Hideaki Joko
Conversational interactions have reshaped information retrieval systems, as users increasingly favour direct answers over traditional hyperlinks. To build reliable Conversational I…
FACE: A Fine-Grained Reference-Free Evaluator for Conversational Information Access
Hideaki Joko, Faegheh Hasibi
A systematic, reliable, and low-cost evaluation of Conversational Information Access (CIA) systems remains an open challenge. Existing reference-based evaluation methods are proven…
WildClaims: Information Access Conversations in the Wild(Chat)
Hideaki Joko, Shakiba Amirshahi, Charles L. A. Clarke +1
The rapid advancement of Large Language Models (LLMs) has transformed conversational systems into practical tools used by millions. However, the nature and necessity of information…
CRS Arena: Crowdsourced Benchmarking of Conversational Recommender Systems
Nolwenn Bernard, Hideaki Joko, Faegheh Hasibi +1
We introduce CRS Arena, a research platform for scalable benchmarking of Conversational Recommender Systems (CRS) based on human feedback. The platform displays pairwise battles be…
Doing Personal LAPS: LLM-Augmented Dialogue Construction for Personalized Multi-Session Conversational Search
Hideaki Joko, Shubham Chatterjee, Andrew Ramsay +3
The future of conversational agents will provide users with personalized information responses. However, a significant challenge in developing models is the lack of large-scale dia…