20 citations · 38 across the 14 of their papers we have counts for
9 papers · 1 filter
Total Recall QA: A Verifiable Evaluation Suite for Deep Research Agents
Mahta Rafiee, Heydar Soudani, Zahra Abbasiantaeb +3
Deep research agents have emerged as LLM-based systems designed to perform multi-step information seeking and reasoning over large, open-domain sources to answer complex questions…
Towards Fair Rankings: Leveraging LLMs for Gender Bias Detection and Measurement
Maryam Mousavian, Zahra Abbasiantaeb, Mohammad Aliannejadi +1
The presence of social biases in Natural Language Processing (NLP) and Information Retrieval (IR) systems is an ongoing challenge, which underlines the importance of developing rob…
Conversational Gold: Evaluating Personalized Conversational Search System using Gold Nuggets
Zahra Abbasiantaeb, Simon Lupart, Leif Azzopardi +2
The rise of personalized conversational search systems has been driven by advancements in Large Language Models (LLMs), enabling these systems to retrieve and generate answers for…
Improving the Reusability of Conversational Search Test Collections
Zahra Abbasiantaeb, Chuan Meng, Leif Azzopardi +1
Incomplete relevance judgments limit the reusability of test collections. When new systems are compared to previous systems that contributed to the pool, they often face a disadvan…
IRLab@iKAT24: Learned Sparse Retrieval with Multi-aspect LLM Query Generation for Conversational Search
Simon Lupart, Zahra Abbasiantaeb, Mohammad Aliannejadi
The Interactive Knowledge Assistant Track (iKAT) 2024 focuses on advancing conversational assistants, able to adapt their interaction and responses from personalized user knowledge…
Can We Use Large Language Models to Fill Relevance Judgment Holes?
Zahra Abbasiantaeb, Chuan Meng, Leif Azzopardi +1
Incomplete relevance judgments limit the re-usability of test collections. When new systems are compared against previous systems used to build the pool of judged documents, they o…
TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants
Mohammad Aliannejadi, Zahra Abbasiantaeb, Shubham Chatterjee +2
Conversational information seeking has evolved rapidly in the last few years with the development of Large Language Models (LLMs), providing the basis for interpreting and respondi…
Generating Multi-Aspect Queries for Conversational Search
Zahra Abbasiantaeb, Simon Lupart, Mohammad Aliannejadi
Conversational information seeking (CIS) systems aim to model the user's information need within the conversational context and retrieve the relevant information. One major approac…
TREC iKAT 2023: The Interactive Knowledge Assistance Track Overview
Mohammad Aliannejadi, Zahra Abbasiantaeb, Shubham Chatterjee +2
Conversational Information Seeking has evolved rapidly in the last few years with the development of Large Language Models providing the basis for interpreting and responding in a…