31 citations · 68 across the 19 of their papers we have counts for
20 papers
"I Know Where to Look," But Does the LLM? Charting the Gaps Between Clinical Expert Needs and Unstructured Data Abstraction Tools
Venkatesh Sivaraman, Rigney Turnham, George Bonano +16
Clinical data abstraction, the process of distilling structured information from patient records, plays a key role in advancing knowledge about diseases such as cancer. Information…
Expert Evaluation of Clinical AI Tools on Real Point-of-Care Clinical Queries
Jean Feng, Vishal Patel, Patrick Heagerty +5
Physicians now pose millions of clinical questions to AI tools each week, yet these tools are evaluated largely on hypothetical or exam-style questions, not those actually asked in…
Adaptive auditing of AI systems with anytime-valid guarantees
Siyu Zhou, Patrick Vossler, Venkatesh Sivaraman +2
A major bottleneck in characterizing the failure modes of generative AI systems is the cost and time of annotation and evaluation. Consequently, adaptive testing paradigms have gai…
From Fuzzy to Formal: Scaling Hospital Quality Improvement with AI
Patrick Vossler, Jean Feng, Venkat Sivaraman +9
Hospital Quality Improvement (QI) plays a critical role in optimizing healthcare delivery by translating high-level hospital goals into actionable solutions. A critical step of QI…
More Than "Means to an End": Supporting Reasoning with Transparently Designed AI Data Science Processes
Venkatesh Sivaraman, Patrick Vossler, Adam Perer +2
Generative artificial intelligence (AI) tools can now help people perform complex data science tasks regardless of their expertise. While these tools have great potential to help m…
Intelligent Reasoning Cues: A Framework and Case Study of the Roles of AI Information in Complex Decisions
Venkatesh Sivaraman, Eric P. Mason, Mengfan Ellen Li +4
Artificial intelligence (AI)-based decision support systems can be highly accurate yet still fail to support users or improve decisions. Existing theories of AI-assisted decision-m…