PRISM: Gauge-Invariant Tangent-Space Differentially Private LoRA

Shihao Wang, Xueru Zhang

Applying differential privacy (DP) via DP-SGD to Low-Rank Adaptation (LoRA) is a natural approach for privacy-preserving fine-tuning. However, LoRA's low-rank parameterization pose…