activity
20192021
most citedImage Counterfactual Sensitivity Analysis for Detecting Unintended Bias

33 citations · 51 across the 5 of their papers we have counts for

collaborators

5 papers

cs.LG2021★ 1 cited

Thinking Beyond Distributions in Testing Machine Learned Models

Negar Rostamzadeh, Ben Hutchinson, Christina Greer +1

Testing practices within the machine learning (ML) community have centered around assessing a learned model's predictive performance measured against a test dataset, often drawn fr…

cs.AI2020

Fairness Preferences, Actual and Hypothetical: A Study of Crowdworker Incentives

Angie Peng, Jeff Naecker, Ben Hutchinson +2

How should we decide which fairness criteria or definitions to adopt in machine learning systems? To answer this question, we must study the fairness preferences of actual users of…

cs.CY2020★ 14 cited

Non-portability of Algorithmic Fairness in India

Nithya Sambasivan, Erin Arnesen, Ben Hutchinson +1

Conventional algorithmic fairness is Western in its sub-groups, values, and optimizations. In this paper, we ask how portable the assumptions of this largely Western take on algori…

cs.CY2019★ 3 cited

Interpreting Social Respect: A Normative Lens for ML Models

Ben Hutchinson, KJ Pittl, Margaret Mitchell

Machine learning is often viewed as an inherently value-neutral process: statistical tendencies in the training inputs are "simply" used to generalize to new examples. However when…

cs.CV2019★ 33 cited

Image Counterfactual Sensitivity Analysis for Detecting Unintended Bias

Remi Denton, Ben Hutchinson, Margaret Mitchell +2

Facial analysis models are increasingly used in applications that have serious impacts on people's lives, ranging from authentication to surveillance tracking. It is therefore crit…