Simple Text Detoxification by Identifying a Linear Toxic Subspace in Language Model Embeddings

Andrew Wang, Mohit Sudhakar, Yangfeng Ji

Large pre-trained language models are often trained on large volumes of internet data, some of which may contain toxic or abusive language. Consequently, language models encode tox…