Detoxifying Language Models with a Toxic Corpus

Yoon A Park, Frank Rudzicz

Existing studies have investigated the tendency of autoregressive language models to generate contexts that exhibit undesired biases and toxicity. Various debiasing approaches have…