31 citations · 59 across the 10 of their papers we have counts for
4 papers · 1 filter
Quantifying and mitigating the impact of label errors on model disparity metrics
Julius Adebayo, Melissa Hall, Bowen Yu +1
Errors in labels obtained via human annotation adversely affect a model's performance. Existing approaches propose ways to mitigate the effect of label error on a model's downstrea…
Understanding out-of-distribution accuracies through quantifying difficulty of test samples
Berfin Simsek, Melissa Hall, Levent Sagun
Existing works show that although modern neural networks achieve remarkable generalization performance on the in-distribution (ID) dataset, the accuracy drops significantly on the…
A Systematic Study of Bias Amplification
Melissa Hall, Laurens van der Maaten, Laura Gustafson +2
Recent research suggests that predictions made by machine-learning models can amplify biases present in the training data. When a model amplifies bias, it makes certain predictions…
Fairness On The Ground: Applying Algorithmic Fairness Approaches to Production Systems
Chloé Bakalar, Renata Barreto, Stevie Bergman +13
Many technical approaches have been proposed for ensuring that decisions made by machine learning systems are fair, but few of these proposals have been stress-tested in real-world…