18 citations · 35 across the 11 of their papers we have counts for
4 papers · 1 filter
Module-Aware Parameter-Efficient Machine Unlearning on Transformers
Wenjie Bao, Jian Lou, Yuke Hu +5
Transformer has become fundamental to a vast series of pre-trained large models that have achieved remarkable success across diverse applications. Machine unlearning, which focuses…
Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint
Zhihao Liu, Jian Lou, Yuke Hu +6
Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership concerns, data owners may request…
Differentially Private Zeroth-Order Methods for Scalable Large Language Model Finetuning
Z Liu, J Lou, W Bao +4
Fine-tuning on task-specific datasets is a widely-embraced paradigm of harnessing the powerful capability of pretrained LLMs for various downstream tasks. Due to the popularity of…
Certified Minimax Unlearning with Generalization Rates and Deletion Capacity
Jiaqi Liu, Jian Lou, Zhan Qin +1
We study the problem of -certified machine unlearning for minimax models. Most of the existing works focus on unlearning from standard statistical learning models that have…