activity
20182025
most citedA Toolbox for Surfacing Health Equity Harms and Biases in Large Language Models

99 citations · 183 across the 8 of their papers we have counts for

collaborators

9 papers

stat.ML2025

Understanding challenges to the interpretation of disaggregated evaluations of algorithmic fairness

Stephen R. Pfohl, Natalie Harris, Chirag Nagpal +12

Disaggregated evaluation across subgroups is critical for assessing the fairness of machine learning models, but its uncritical use can mislead practitioners. We show that equal pe…

cs.LG2024★ 6 cited

Nteasee: Understanding Needs in AI for Health in Africa -- A Mixed-Methods Study of Expert and General Population Perspectives

Mercy Nyamewaa Asiedu, Iskandar Haykel, Awa Dieng +7

Artificial Intelligence (AI) for health has the potential to significantly change and improve healthcare. However in most African countries, identifying culturally and contextually…

cs.CL2024★ 2 cited

Contextual Evaluation of Large Language Models for Classifying Tropical and Infectious Diseases

Mercy Asiedu, Nenad Tomasev, Chintan Ghate +9

While large language models (LLMs) have shown promise for medical question answering, there is limited work focused on tropical and infectious disease-specific exploration. We buil…

cs.AI2024★ 21 cited

The Case for Globalizing Fairness: A Mixed Methods Study on Colonialism, AI, and Health in Africa

Mercy Asiedu, Awa Dieng, Iskandar Haykel +7

With growing application of machine learning (ML) technologies in healthcare, there have been calls for developing techniques to understand and mitigate biases these systems may ex…

cs.CY2024★ 99 cited

A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Models

Stephen R. Pfohl, Heather Cole-Lewis, Rory Sayres +27

Large language models (LLMs) hold promise to serve complex health information needs but also have the potential to introduce harm and exacerbate health disparities. Reliably evalua…

cs.LG2023★ 21 cited

Globalizing Fairness Attributes in Machine Learning: A Case Study on Health in Africa

Mercy Nyamewaa Asiedu, Awa Dieng, Abigail Oppong +3

With growing machine learning (ML) applications in healthcare, there have been calls for fairness in ML to understand and mitigate ethical concerns these systems may pose. Fairness…

cs.LG2022★ 32 cited

Diagnosing failures of fairness transfer across distribution shift in real-world medical settings

Jessica Schrouff, Natalie Harris, Oluwasanmi Koyejo +14

Diagnosing and mitigating changes in model fairness under distribution shift is an important component of the safe deployment of machine learning in healthcare settings. Importantl…

stat.ME2020

Causal inference methods for combining randomized trials and observational studies: a review

Bénédicte Colnet, Imke Mayer, Guanhua Chen +6

With increasing data availability, causal effects can be evaluated across different data sets, both randomized controlled trials (RCTs) and observational studies. RCTs isolate the…

stat.ML2018★ 2 cited

Interpretable Almost Matching Exactly for Causal Inference

Yameng Liu, Aw Dieng, Sudeepa Roy +2

We aim to create the highest possible quality of treatment-control matches for categorical data in the potential outcomes framework. Matching methods are heavily used in the social…