8 papers · 1 filter
Re-Rankers as Relevance Judges
Chuan Meng, Jiqun Liu, Mohammad Aliannejadi +3
Using large language models (LLMs) to predict relevance judgments has shown promising results. Most studies treat this task as a distinct research line, e.g., focusing on prompt de…
Conversational Search: From Fundamentals to Frontiers in the LLM Era
Fengran Mo, Chuan Meng, Mohammad Aliannejadi +1
Conversational search enables multi-turn interactions between users and systems to fulfill users' complex information needs. During this interaction, the system should understand t…
Improving the Reusability of Conversational Search Test Collections
Zahra Abbasiantaeb, Chuan Meng, Leif Azzopardi +1
Incomplete relevance judgments limit the reusability of test collections. When new systems are compared to previous systems that contributed to the pool, they often face a disadvan…
Zero-Shot and Efficient Clarification Need Prediction in Conversational Search
Lili Lu, Chuan Meng, Federico Ravenda +2
Clarification need prediction (CNP) is a key task in conversational search, aiming to predict whether to ask a clarifying question or give an answer to the current user query. Howe…
Generative Retrieval with Few-shot Indexing
Arian Askari, Chuan Meng, Mohammad Aliannejadi +3
Existing generative retrieval (GR) methods rely on training-based indexing, which fine-tunes a model to memorise associations between queries and the document identifiers (docids)…
Can We Use Large Language Models to Fill Relevance Judgment Holes?
Zahra Abbasiantaeb, Chuan Meng, Leif Azzopardi +1
Incomplete relevance judgments limit the re-usability of test collections. When new systems are compared against previous systems used to build the pool of judged documents, they o…