activity
20242026
most citedMedHELM: Holistic Evaluation of Large Language Models for Medical Tasks

10 citations · 19 across the 6 of their papers we have counts for

collaborators

10 papers

cs.HC2026

"Are you an AI?" Analyzing Client Suspicion of AI Use in Crisis Counseling

Shreya Shah, Akshay Swaminathan, Meghana Simhadri +14

As artificial intelligence (AI) tools get increasingly deployed for mental healthcare, public trust in these systems remains uncertain. It is unclear how clients perceive AI involv…

cs.CL2025

Structured Prompts Improve Evaluation of Language Models

Asad Aali, Muhammad Ahmed Mohsin, Vasiliki Bikia +15

As language models (LMs) are increasingly adopted across domains, high-quality benchmarking frameworks are essential for guiding deployment decisions. In practice, however, framewo…

cs.CL2025

MedFactEval and MedAgentBrief: A Framework and Workflow for Generating and Evaluating Factual Clinical Summaries

François Grolleau, Emily Alsentzer, Timothy Keyes +17

Evaluating factual accuracy in Large Language Model (LLM)-generated clinical text is a critical barrier to adoption, as expert review is unscalable for the continuous quality assur…

cs.CL202510 cited

MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks

Suhana Bedi, Hejie Cui, Miguel Fuentes +78

While large language models (LLMs) achieve near-perfect scores on medical licensing exams, these evaluations inadequately reflect the complexity and diversity of real-world clinica…

cs.AI20252 cited

VeriFact: Verifying Facts in LLM-Generated Clinical Text with Electronic Health Records

Philip Chung, Akshay Swaminathan, Alex J. Goodell +26

Methods to ensure factual accuracy of text generated by large language models (LLM) in clinical medicine are lacking. VeriFact is an artificial intelligence system that combines re…

cs.CL20242 cited

Distilling Large Language Models for Efficient Clinical Information Extraction

Karthik S. Vedula, Annika Gupta, Akshay Swaminathan +3

Large language models (LLMs) excel at clinical information extraction but their computational demands limit practical deployment. Knowledge distillation--the process of transferrin…