Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Sensitivity Inflation from Cross-Record Precision Routing in Private Quantized Fine-Tuning
Annan Zhang, Shengjie Song, Wenshuai Yao +2
Private fine-tuning of large language models increasingly pairs DP-SGD with low-rank adapters on frozen, quantized backbones, and every such stack inherits one unstated premise: fr…
cs.LG2026
Guarded Compression of Adam Optimizer State with Shared-Gradient Bounds
Annan Zhang, Shengjie Song, Wenshuai Yao +2
Adam keeps two FP32 moments per parameter, twice the bytes of the FP32 weights, yet compressing them is risky: the update divides by the square root of the second moment, so small…