Crossing the Margin Cliff: Toward Relearn-Robust LLM Unlearning via Margin Calibration

Xiangyu Yin, Jiaxu Liu, Zhen Chen +1

Large language model unlearning is consistently fragile under relearn attacks. On TOFU, fine-tuning on twenty forget examples substantially recovers held-out forget-set ROUGE for e…