5 papers
Overview of TREC 2025 Biomedical Generative Retrieval (BioGen) Track
Deepak Gupta, Dina Demner-Fushman, William Hersh +2
Recent advances in large language models (LLMs) have made significant progress across multiple biomedical tasks, including biomedical question answering, lay-language summarization…
BioACE: An Automated Framework for Biomedical Answer and Citation Evaluations
Deepak Gupta, Davis Bartels, Dina Demner-Fushman
With the increasing use of large language models (LLMs) for generating answers to biomedical questions, it is crucial to evaluate the quality of the generated answers and the refer…
A Dataset and Benchmark for Consumer Healthcare Question Summarization
Abhishek Basu, Deepak Gupta, Dina Demner-Fushman +1
The quest for seeking health information has swamped the web with consumers health-related questions. Generally, consumers use overly descriptive and peripheral information to expr…
Overview of TREC 2024 Medical Video Question Answering (MedVidQA) Track
Deepak Gupta, Dina Demner-Fushman
One of the key goals of artificial intelligence (AI) is the development of a multimodal system that facilitates communication with the visual world (image and video) using a natura…
Overview of TREC 2024 Biomedical Generative Retrieval (BioGen) Track
Deepak Gupta, Dina Demner-Fushman, William Hersh +2
With the advancement of large language models (LLMs), the biomedical domain has seen significant progress and improvement in multiple tasks such as biomedical question answering, l…