21 papers
When Deep Research Agents Stagnate: Enhancing Reasoning with Retrieval-Aware Agent Control
Heydar Soudani, Elizabeth Lingg, Faegheh Hasibi +1
In this paper, we analyze the reasoning trajectories of a variety of DRAs and show that existing agents often suffer from reasoning stagnation: the majority of iterations contribut…
Uncertainty Quantification for Multimodal Retrieval Augmented Generation
Simon Binz, Heydar Soudani, Faegheh Hasibi
Retrieval Augmented Generation (RAG) improves the question answering capabilities of Large Language Models (LLMs) by incorporating external knowledge and has recently been extended…
A Survey on Recent Advances in Conversational Data Generation
Heydar Soudani, Roxana Petcu, Evangelos Kanoulas +1
Recent advancements in conversational systems have significantly enhanced human-machine interactions across various domains. However, training these systems is challenging due to t…
Uncertainty Quantification for Retrieval-Augmented Reasoning
Heydar Soudani, Hamed Zamani, Faegheh Hasibi
Retrieval-augmented reasoning (RAR) is a recent evolution of retrieval-augmented generation (RAG) that employs multiple reasoning steps for retrieval and generation. While effectiv…
Reproducing Complex Set-Compositional Information Retrieval
Vincent Degenhart, Dewi Timman, Arjen P. de Vries +2
Complex information needs may involve set-compositional queries using conjunction, disjunction, and exclusion, yet it remains unclear whether current retrieval paradigms genuinely…
FACE: A Fine-Grained Reference-Free Evaluator for Conversational Information Access
Hideaki Joko, Faegheh Hasibi
A systematic, reliable, and low-cost evaluation of Conversational Information Access (CIA) systems remains an open challenge. Existing reference-based evaluation methods are proven…