79 citations · 126 across the 43 of their papers we have counts for
41 papers · 1 filter
CARE-LoRA: Compressed Activation REconstruction for Memory-Efficient LoRA
Gengyu Zhang, Haiyin Ran, Zhengbao He +4
As the scale of large pre-trained models continues to grow, fine-tuning them under limited memory budgets has become increasingly challenging. Low-Rank Adaptation (LoRA), currently…
SAGE: Retain-Aware Post-Hoc Sanitization of Final Unlearning Vector
Jingyuan Zhang, Yucheng Bai, Peixi Wen +6
Large Language Model (LLM) unlearning aims to remove undesirable knowledge or behaviors while preserving retained capabilities. Current unlearning methods all involve a trade-off b…
Compress then Merge: From Multiple LoRAs into One Low-Rank Adapter
Zhengbao He, Ruiqi Ding, Zhehao Huang +3
Low-rank adaptation (LoRA) enables parameter-efficient specialization of foundation models, but the proliferation of task-specific adapters fragments capabilities across many adapt…
A Full-Pipeline Framework for Evaluating Membership Inference Attacks in Machine Learning
Ding Chen, Xinwen Cheng, Xuyang Zhong +3
While Membership Inference Attacks (MIAs) are the prevailing method for identifying training data, their application has expanded into privacy auditing and machine unlearning. Neve…
Compensation-free Machine Unlearning in Text-to-Image Diffusion Models by Eliminating the Mutual Information
Xinwen Cheng, Jingyuan Zhang, Zhehao Huang +2
The powerful generative capabilities of diffusion models have raised growing privacy and safety concerns regarding generating sensitive or undesired content. In response, machine u…
RAIN-Merging: A Gradient-Free Method to Enhance Instruction Following in Large Reasoning Models with Preserved Thinking Format
Zhehao Huang, Yuhang Liu, Baijiong Lin +5
Large reasoning models (LRMs) excel at a long chain of reasoning but often fail to faithfully follow instructions regarding output format, constraints, or specific requirements. We…