3 papers
cs.LG2026
Sensitivity Inflation from Cross-Record Precision Routing in Private Quantized Fine-Tuning
Annan Zhang, Shengjie Song, Wenshuai Yao +2
Private fine-tuning of large language models increasingly pairs DP-SGD with low-rank adapters on frozen, quantized backbones, and every such stack inherits one unstated premise: fr…
cs.AI2026
State-Aware Activation Recomputation with Replay Contracts and Selective Preservation
Annan Zhang, Shengjie Song, Wenshuai Yao +2
Activation recomputation saves accelerator memory by replaying forward segments during the backward pass, but replay is only correct if it sees the state the original forward pass…
cs.LG2026
Guarded Compression of Adam Optimizer State with Shared-Gradient Bounds
Annan Zhang, Shengjie Song, Wenshuai Yao +2
Adam keeps two FP32 moments per parameter, twice the bytes of the FP32 weights, yet compressing them is risky: the update divides by the square root of the second moment, so small…