5 papers
PatientAgentBench: A Benchmark Framework for Evaluating Patient-Facing Health AI Agents
Korosh Vatanparvar, Ashutosh Joshi, Maria Xenochristou +11
Health AI is evolving from answering questions to agentic systems that converse with patients, reason about health records, and act on their behalf. Primary care guards against dia…
IMCBench: A benchmark for multimodal LLMs in Image-grounded Medical Conversations
Maria Xenochristou, Ashutosh Joshi, Korosh Vatanparvar +10
Recent advances in large language models and vision-language models have enabled reasoning over multimodal data, offering opportunities for clinical applications such as decision s…
Linking Knowledge to Care: Knowledge Graph-Augmented Medical Follow-Up Question Generation
Liwen Sun, Xiang Yu, Ming Tan +4
Clinical diagnosis is time-consuming, requiring intensive interactions between patients and medical professionals. While large language models (LLMs) could ease the pre-diagnostic…
Exploring Query Understanding for Amazon Product Search
Chen Luo, Xianfeng Tang, Hanqing Lu +12
Online shopping platforms, such as Amazon, offer services to billions of people worldwide. Unlike web search or other search engines, product search engines have their unique chara…
REAPER: Reasoning based Retrieval Planning for Complex RAG Systems
Ashutosh Joshi, Sheikh Muhammad Sarwar, Samarth Varshney +3
Complex dialog systems often use retrieved evidence to facilitate factual responses. Such RAG (Retrieval Augmented Generation) systems retrieve from massive heterogeneous data stor…