4 papers
Personalization and Evaluation of Conversational Information Access
Hideaki Joko
Conversational interactions have reshaped information retrieval systems, as users increasingly favour direct answers over traditional hyperlinks. To build reliable Conversational I…
FACE: A Fine-Grained Reference-Free Evaluator for Conversational Information Access
Hideaki Joko, Faegheh Hasibi
A systematic, reliable, and low-cost evaluation of Conversational Information Access (CIA) systems remains an open challenge. Existing reference-based evaluation methods are proven…
WildClaims: Information Access Conversations in the Wild(Chat)
Hideaki Joko, Shakiba Amirshahi, Charles L. A. Clarke +1
The rapid advancement of Large Language Models (LLMs) has transformed conversational systems into practical tools used by millions. However, the nature and necessity of information…
CRS Arena: Crowdsourced Benchmarking of Conversational Recommender Systems
Nolwenn Bernard, Hideaki Joko, Faegheh Hasibi +1
We introduce CRS Arena, a research platform for scalable benchmarking of Conversational Recommender Systems (CRS) based on human feedback. The platform displays pairwise battles be…