5 papers · 1 filter
MedVAL: Toward Expert-Level Medical Text Validation with Language Models
Asad Aali, Vasiliki Bikia, Maya Varma +24
With the growing use of language models (LMs) in clinical environments, there is an immediate need to evaluate the accuracy and safety of LM-generated medical text. Currently, such…
Zero-shot Performance of Generative AI in Brazilian Portuguese Medical Exam
Cesar Augusto Madid Truyts, Amanda Gomes Rabelo, Gabriel Mesquita de Souza +7
Artificial intelligence (AI) has shown the potential to revolutionize healthcare by improving diagnostic accuracy, optimizing workflows, and personalizing treatment plans. Large La…
Automated Structured Radiology Report Generation
Jean-Benoit Delbrouck, Justin Xu, Johannes Moll +11
Automated radiology report generation from chest X-ray (CXR) images has the potential to improve clinical efficiency and reduce radiologists' workload. However, most datasets, incl…
MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks
Suhana Bedi, Hejie Cui, Miguel Fuentes +78
While large language models (LLMs) achieve near-perfect scores on medical licensing exams, these evaluations inadequately reflect the complexity and diversity of real-world clinica…
A dataset and benchmark for hospital course summarization with adapted large language models
Asad Aali, Dave Van Veen, Yamin Ishraq Arefeen +9
Brief hospital course (BHC) summaries are clinical documents that summarize a patient's hospital stay. While large language models (LLMs) depict remarkable capabilities in automati…