Debiasing should be Good and Bad: Measuring the Consistency of Debiasing Techniques in Language Models

Robert Morabito, Jad Kabbara, Ali Emami

Debiasing methods that seek to mitigate the tendency of Language Models (LMs) to occasionally output toxic or inappropriate text have recently gained traction. In this paper, we pr…