Towards classification parity across cohorts
arXiv:2005.08033
Abstract
Recently, there has been a lot of interest in ensuring algorithmic fairness in machine learning where the central question is how to prevent sensitive information (e.g. knowledge about the ethnic group of an individual) from adding "unfair" bias to a learning algorithm (Feldman et al. (2015), Zemel et al. (2013)). This has led to several debiasing algorithms on word embeddings (Qian et al. (2019) , Bolukbasi et al. (2016)), coreference resolution (Zhao et al. (2018a)), semantic role labeling (Zhao et al. (2017)), etc. Most of these existing work deals with explicit sensitive features such as gender, occupations or race which doesn't work with data where such features are not captured due to privacy concerns. In this research work, we aim to achieve classification parity across explicit as well as implicit sensitive features. We define explicit cohorts as groups of people based on explicit sensitive attributes provided in the data (age, gender, race) whereas implicit cohorts are defined as groups of people with similar language usage. We obtain implicit cohorts by clustering embeddings of each individual trained on the language generated by them using a language model. We achieve two primary objectives in this work : [1.] We experimented and discovered classification performance differences across cohorts based on implicit and explicit features , [2] We improved classification parity by introducing modification to the loss function aimed to minimize the range of model performances across cohorts.
arXiv commentPublished in ML-IRL ICLR 2020 workshop
References in corpus (10)
- Teaching Machines to Read and Comprehend
- Equality of Opportunity in Supervised Learning
- Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
- Counterfactual Fairness
- Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them
- Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
- Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods
- A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle
- Learning Gender-Neutral Word Embeddings
- Reducing Gender Bias in Word-Level Language Models with a Gender-Equalizing Loss Function