RobustDebias: Debiasing Language Models using Distributionally Robust Optimization

Deep Gandhi, Katyani Singh, Nidhi Hegde

Pretrained language models have been shown to exhibit biases and social stereotypes. Prior work on debiasing these models has largely focused on modifying embedding spaces during p…