activity
20242026
most citedMedHELM: Holistic Evaluation of Large Language Models for Medical Tasks

10 citations · 17 across the 5 of their papers we have counts for

collaborators

5 papers

cs.AI2026

PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments

Ruoqi Liu, Imran Q. Mohiuddin, Austin J. Schoeffler +10

We introduce PhysicianBench, a benchmark for evaluating LLM agents on physician tasks grounded in real clinical setting within electronic health record (EHR) environments. Existing…

cs.HC2026

Clinician input steers AI toward accurate and harmful recommendations

Ivan Lopez, Selin S. Everett, Bryan J. Bunning +10

Large language models (LLMs) are entering clinical workflows, yet evaluations rarely assess how clinician reasoning shapes model behavior during clinical interactions. Using 61 cur…

cs.CY2026★ 2 cited

Adoption and Use of LLMs at an Academic Medical Center

Nigam H. Shah, Nerissa Ambers, Abby Pandya +55

While large language models (LLMs) can support clinical documentation needs, standalone tools struggle with "workflow friction" from manual data entry. We developed ChatEHR, a syst…

cs.CL2025★ 10 cited

MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks

Suhana Bedi, Hejie Cui, Miguel Fuentes +78

While large language models (LLMs) achieve near-perfect scores on medical licensing exams, these evaluations inadequately reflect the complexity and diversity of real-world clinica…

cs.CL2024★ 5 cited

Answering real-world clinical questions using large language model based systems

Yen Sia Low, Michael L. Jackson, Rebecca J. Hyde +24

Evidence to guide healthcare decisions is often limited by a lack of relevant and trustworthy literature as well as difficulty in contextualizing existing research for a specific p…