End-To-End Bias Mitigation: Removing Gender Bias in Deep Learning
arXiv:2104.02532
Abstract
Machine Learning models have been deployed across many different aspects of society, often in situations that affect social welfare. Although these models offer streamlined solutions to large problems, they may contain biases and treat groups or individuals unfairly based on protected attributes such as gender. In this paper, we introduce several examples of machine learning gender bias in practice followed by formalizations of fairness. We provide a survey of fairness research by detailing influential pre-processing, in-processing, and post-processing bias mitigation algorithms. We then propose an end-to-end bias mitigation framework, which employs a fusion of pre-, in-, and post-processing methods to leverage the strengths of each individual technique. We test this method, along with the standard techniques we review, on a deep neural network to analyze bias mitigation in a deep learning setting. We find that our end-to-end bias mitigation framework outperforms the baselines with respect to several fairness metrics, suggesting its promise as a method for improving fairness. As society increasingly relies on artificial intelligence to help in decision-making, addressing gender biases present in deep learning models is imperative. To provide readers with the tools to assess the fairness of machine learning models and mitigate the biases present in them, we discuss multiple open source packages for fairness in AI.
arXiv comment9 pages, 1 figure
References in corpus (16)
- Equality of Opportunity in Supervised Learning
- Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
- Counterfactual Fairness
- On Fairness and Calibration
- AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias
- Learning Non-Discriminatory Predictors
- On Formalizing Fairness in Prediction with Machine Learning
- FairSight: Visual Analytics for Fairness in Decision Making
- Achieving Fairness through Adversarial Learning: an Application to Recidivism Prediction
- Aequitas: A Bias and Fairness Audit Toolkit
- Learning Optimal Fair Policies
- Fairness-aware Classification: Criterion, Convexity, and Bounds
- A survey of bias in Machine Learning through the prism of Statistical Parity for the Adult Data Set
- Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes
- Debiasing Community Detection: The Importance of Lowly-Connected Nodes
- Bias Mitigation Post-processing for Individual and Group Fairness