25.8k citations · 60.8k across the 52 of their papers we have counts for
52 papers
General Geospatial Inference with a Population Dynamics Foundation Model
Mohit Agarwal, Mimi Sun, Chaitanya Kamath +31
Supporting the health and well-being of dynamic populations around the world requires governmental agencies, organizations and researchers to understand and reason over complex rel…
PathAlign: A vision-language model for whole slide images in histopathology
Faruk Ahmed, Andrew Sellergren, Lin Yang +14
Microscopic interpretation of histopathology images underlies many important diagnostic and treatment decisions. While advances in vision-language modeling raise new opportunities…
Towards a Personal Health Large Language Model
Justin Cosentino, Anastasiya Belyaeva, Xin Liu +31
In health, most large language model (LLM) research has focused on clinical tasks. However, mobile and wearable devices, which are rarely integrated into such tasks, provide rich,…
HeAR -- Health Acoustic Representations
Sebastien Baur, Zaid Nabulsi, Wei-Hung Weng +15
Health acoustic sounds such as coughs and breaths are known to contain useful health signals with significant potential for monitoring health and disease, yet are underexplored in…
A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Models
Stephen R. Pfohl, Heather Cole-Lewis, Rory Sayres +27
Large language models (LLMs) hold promise to serve complex health information needs but also have the potential to introduce harm and exacerbate health disparities. Reliably evalua…
Crowdsourcing Dermatology Images with Google Search Ads: Creating a Real-World Skin Condition Dataset
Abbi Ward, Jimmy Li, Julie Wang +17
Background: Health datasets from clinical sources do not reflect the breadth and diversity of disease in the real world, impacting research, medical education, and artificial intel…
Closing the AI generalization gap by adjusting for dermatology condition distribution differences across clinical settings
Rajeev V. Rikhye, Aaron Loh, Grace Eunhae Hong +23
Recently, there has been great progress in the ability of artificial intelligence (AI) algorithms to classify dermatological conditions from clinical photographs. However, little i…
Towards Conversational Diagnostic AI
Tao Tu, Anil Palepu, Mike Schaekermann +22
At the heart of medicine lies the physician-patient dialogue, where skillful history-taking paves the way for accurate diagnosis, effective management, and enduring trust. Artifici…
Towards Accurate Differential Diagnosis with Large Language Models
Daniel McDuff, Mike Schaekermann, Tao Tu +25
An accurate differential diagnosis (DDx) is a cornerstone of medical care, often reached through an iterative process of interpretation that combines clinical history, physical exa…
Domain-specific optimization and diverse evaluation of self-supervised models for histopathology
Jeremy Lai, Faruk Ahmed, Supriya Vijay +13
Task-specific deep learning models in histopathology offer promising opportunities for improving diagnosis, clinical research, and precision medicine. However, development of such…
ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoders
Shawn Xu, Lin Yang, Christopher Kelly +25
In this work, we present an approach, which we call Embeddings for Language/Image-aligned X-Rays, or ELIXR, that leverages a language-aligned image encoder combined or grafted onto…
Towards Generalist Biomedical AI
Tao Tu, Shekoofeh Azizi, Danny Driess +29
Medicine is inherently multimodal, with rich data modalities spanning text, imaging, genomics, and more. Generalist biomedical artificial intelligence (AI) systems that flexibly en…
Multimodal LLMs for health grounded in individual-specific data
Anastasiya Belyaeva, Justin Cosentino, Farhad Hormozdiari +6
Foundation large language models (LLMs) have shown an impressive ability to solve tasks across a wide range of fields including health. To effectively solve personalized health tas…
Evaluating AI systems under uncertain ground truth: a case study in dermatology
David Stutz, Ali Taylan Cemgil, Abhijit Guha Roy +17
For safety, medical AI systems undergo thorough evaluations before deployment, validating their predictions against a ground truth which is assumed to be fixed and certain. However…
Using generative AI to investigate medical imagery models and datasets
Oran Lang, Doron Yaya-Stupp, Ilana Traynis +13
AI models have shown promise in many medical imaging tasks. However, our ability to explain what signals these models have learned is severely lacking. Explanations are needed in o…
Towards Expert-Level Medical Question Answering with Large Language Models
Karan Singhal, Tao Tu, Juraj Gottweis +28
Recent artificial intelligence (AI) systems have reached milestones in "grand challenges" ranging from Go to protein-folding. The capability to retrieve medical knowledge, reason o…
Predicting Cardiovascular Disease Risk using Photoplethysmography and Deep Learning
Wei-Hung Weng, Sebastien Baur, Mayank Daswani +13
Cardiovascular diseases (CVDs) are responsible for a large proportion of premature deaths in low- and middle-income countries. Early CVD detection and intervention is critical in t…
Large Language Models Encode Clinical Knowledge
Karan Singhal, Shekoofeh Azizi, Tao Tu +27
Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications i…
Discovering novel systemic biomarkers in photos of the external eye
Boris Babenko, Ilana Traynis, Christina Chen +16
External eye photos were recently shown to reveal signs of diabetic retinal disease and elevated HbA1c. In this paper, we evaluate if external eye photos contain information about…
Robust and Efficient Medical Imaging with Self-Supervision
Shekoofeh Azizi, Laura Culp, Jan Freyberg +31
Recent progress in Medical Artificial Intelligence (AI) has delivered systems that can reach clinical expert level performance. However, such systems tend to demonstrate sub-optima…
AI system for fetal ultrasound in low-resource settings
Ryan G. Gomes, Bellington Vwalika, Chace Lee +26
Despite considerable progress in maternal healthcare, maternal and perinatal deaths remain high in low-to-middle income countries. Fetal ultrasound is an important component of ant…
Vaccine Search Patterns Provide Insights into Vaccination Intent
Sean Malahy, Mimi Sun, Keith Spangler +20
Despite ample supply of COVID-19 vaccines, the proportion of fully vaccinated individuals remains suboptimal across much of the US. Rapid vaccination of additional people will prev…
Deep learning for detecting pulmonary tuberculosis via chest radiography: an international study across 10 countries
Sahar Kazemzadeh, Jin Yu, Shahar Jamshy +21
Tuberculosis (TB) is a top-10 cause of death worldwide. Though the WHO recommends chest radiographs (CXRs) for TB screening, the limited availability of CXR interpretation is a bar…
Does Your Dermatology Classifier Know What It Doesn't Know? Detecting the Long-Tail of Unseen Conditions
Abhijit Guha Roy, Jie Ren, Shekoofeh Azizi +18
We develop and rigorously evaluate a deep learning based system that can accurately classify skin conditions while detecting rare conditions for which there is not enough data avai…