SAU: Sparsity-Aware Unlearning for LLMs via Gradient Masking and Importance Redistribution

Yuze Wang, Yujia Tong, Xuan Liu +1

Large Language Models (LLMs) inevitably memorize sensitive information during training, posing significant privacy risks. Machine unlearning has emerged as a promising solution to…