152 citations · 659 across the 17 of their papers we have counts for
7 papers · 1 filter
DataPerf: Benchmarks for Data-Centric AI Development
Mark Mazumder, Colby Banbury, Xiaozhe Yao +42
Machine learning research has long focused on models rather than datasets, and prominent datasets are used for common ML tasks without regard to the breadth, difficulty, and faithf…
Data Valuation for Medical Imaging Using Shapley Value: Application on A Large-scale Chest X-ray Dataset
Siyi Tang, Amirata Ghorbani, Rikiya Yamashita +4
The reliability of machine learning models can be compromised when trained on low quality data. Many large-scale medical imaging datasets contain low quality labels extracted from…
How Does Mixup Help With Robustness and Generalization?
Linjun Zhang, Zhun Deng, Kenji Kawaguchi +2
Mixup is a popular data augmentation technique based on taking convex combinations of pairs of examples and their labels. This simple technique has been shown to substantially impr…
Improving Adversarial Robustness via Unlabeled Out-of-Domain Data
Zhun Deng, Linjun Zhang, Amirata Ghorbani +1
Data augmentation by incorporating cheap unlabeled data from multiple domains is a powerful way to improve prediction especially when there is limited labeled data. In this work, w…
A Distributional Framework for Data Valuation
Amirata Ghorbani, Michael P. Kim, James Zou
Shapley value is a classic notion from game theory, historically used to quantify the contributions of individuals within groups, and more recently applied to assign values to data…
Who's responsible? Jointly quantifying the contribution of the learning algorithm and training data
Gal Yona, Amirata Ghorbani, James Zou
A learning algorithm trained on a dataset is revealed to have poor performance on some subpopulation at test time. Where should the responsibility for this lay? It can be a…
Multiaccuracy: Black-Box Post-Processing for Fairness in Classification
Michael P. Kim, Amirata Ghorbani, James Zou
Prediction systems are successfully deployed in applications ranging from disease diagnosis, to predicting credit worthiness, to image recognition. Even when the overall accuracy i…