4 papers
A Living Benchmark for Information Retrieval from Electronic Health Records
Jordan L. Cahoon, Chloe O. Stanwyck, Sulaiman Somani +23
Large language model (LLM)-based clinical assistants are increasingly being integrated into electronic health record (EHR) systems, transforming how clinicians retrieve and synthes…
Clinically Grounded Privacy Evaluation of Medical LMs
Sasha Ronaghi, Sana Tonekaboni, Lena Stempfle +6
Medical language models (LMs) can memorize and reproduce protected health information, but privacy evaluations often focus on recovery of training text rather than disclosure under…
Clinical Note Bloat Reduction for Efficient LLM Use
Jordan L. Cahoon, Chloe Stanwyck, Asad Aali +6
Background: Clinical notes contain extensive duplicated text from templates, copy-paste, and auto-populated fields ("note bloat"), diluting clinical signal, limiting longitudinal c…
Structured Prompts Improve Evaluation of Language Models
Asad Aali, Muhammad Ahmed Mohsin, Vasiliki Bikia +15
As language models (LMs) are increasingly adopted across domains, high-quality benchmarking frameworks are essential for guiding deployment decisions. In practice, however, framewo…