2 papers
cs.LG2026
CARE-LoRA: Compressed Activation REconstruction for Memory-Efficient LoRA
Gengyu Zhang, Haiyin Ran, Zhengbao He +4
As the scale of large pre-trained models continues to grow, fine-tuning them under limited memory budgets has become increasingly challenging. Low-Rank Adaptation (LoRA), currently…
cs.LG2026
SAGE: Retain-Aware Post-Hoc Sanitization of Final Unlearning Vector
Jingyuan Zhang, Yucheng Bai, Peixi Wen +6
Large Language Model (LLM) unlearning aims to remove undesirable knowledge or behaviors while preserving retained capabilities. Current unlearning methods all involve a trade-off b…