Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance

Gizem Yüce, Giorgos Nikolaou, Nicolas Flammarion

Machine unlearning aims to remove targeted knowledge from a trained model while preserving its general capabilities. For autoregressive language models, not all tokens in a forget…