Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns

Zhongbin Xie, Vid Kocijan, Thomas Lukasiewicz +1

Bias-measuring datasets play a critical role in detecting biased behavior of language models and in evaluating progress of bias mitigation methods. In this work, we focus on evalua…