On the Hidden Costs of Counterfactual Knowledge Training in LLM Unlearning

Xiaotian Ye, Xiaohan Wang, Mengqi Zhang +1

Counterfactual tuning (CFT) has emerged as a promising paradigm for Large Language Model (LLM) unlearning by training models to generate alternative fictitious knowledge in place o…