Evaluating Gender Bias in Natural Language Inference

Abstract

Gender-bias stereotypes have recently raised significant ethical concerns in natural language processing. However, progress in detection and evaluation of gender bias in natural language understanding through inference is limited and requires further investigation. In this work, we propose an evaluation methodology to measure these biases by constructing a challenge task that involves pairing gender-neutral premises against a gender-specific hypothesis. We use our challenge task to investigate state-of-the-art NLI models on the presence of gender stereotypes using occupations. Our findings suggest that three models (BERT, RoBERTa, BART) trained on MNLI and SNLI datasets are significantly prone to gender-induced prediction errors. We also find that debiasing techniques such as augmenting the training dataset to ensure a gender-balanced dataset can help reduce such bias in certain cases.

arXiv commentNeurIPS 2020 Workshop on Dataset Curation and Security

References in corpus (9)

• Semantics derived automatically from language corpora contain human-like biases
• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
• Adversarial Examples for Evaluating Reading Comprehension Systems
• Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them
• Understanding the Origins of Bias in Word Embeddings
• Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods
• Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases
• Unlearn Dataset Bias in Natural Language Inference by Fitting the Residual
• Towards Robustifying NLI Models Against Lexical Dataset Biases