Detoxification of Large Language Models through Output-layer Fusion with a Calibration Model

Yuanhe Tian, Mingjie Deng, Guoqing Jin +1

Existing approaches for Large language model (LLM) detoxification generally rely on training on large-scale non-toxic or human-annotated preference data, designing prompts to instr…