Why Is My Classifier Discriminatory?

Abstract

Recent attempts to achieve fairness in predictive models focus on the balance between fairness and accuracy. In sensitive applications such as healthcare or criminal justice, this trade-off is often undesirable as any increase in prediction error could have devastating consequences. In this work, we argue that the fairness of predictions should be evaluated in context of the data, and that unfairness induced by inadequate samples sizes or unmeasured predictive variables should be addressed through data collection, rather than by constraining the model. We decompose cost-based metrics of discrimination into bias, variance, and noise, and propose actions aimed at estimating and reducing each term. Finally, we perform case-studies on prediction of income, mortality, and review ratings, confirming the value of this analysis. We find that data collection is often a means to reduce discrimination without sacrificing accuracy.

arXiv commentAppeared in Advances in Neural Information Processing Systems (NeurIPS 2018); 3 figures, 8 pages, 6 page supplementary

Cited by in corpus (15)

• Fairness in Machine Learning: A Survey
• An Empirical Characterization of Fair Machine Learning For Clinical Risk Prediction
• Representation Bias in Data: A Survey on Identification and Resolution Techniques
• Assessing and Remedying Coverage for a Given Dataset
• Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation
• Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Tools
• Using Error Decay Prediction to Overcome Practical Issues of Deep Active Learning for Named Entity Recognition
• Evaluating the Impact of Social Determinants on Health Prediction in the Intensive Care Unit
• Artificial mental phenomena: Psychophysics as a framework to detect perception biases in AI models
• Algorithms that "Don't See Color": Comparing Biases in Lookalike and Special Ad Audiences
• FAIR: Fairness-Aware Information Retrieval Evaluation
• Fair-SSL: Building fair ML Software with less data
• Learning Fair and Interpretable Representations via Linear Orthogonalization
• Patterns Count-Based Labels for Datasets
• A unifying approach on bias and variance analysis for classification