Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
RAPTOR: Role-Aware Private Training for Mixture-of-Experts
Duc Dm, Khai Le-Duc, Nguyen Do +18
Differentially private (DP) fine-tuning methods treat sparse Mixture-of-Experts (MoE) models as a single dense block, ignoring that shared layers see all data while experts only se…
cs.LG2026
FIBER: A Differentially Private Optimizer with Filter-Aware Innovation Bias Correction
Duc Dm, Thao Do, Minh Son Hoang +3
Differentially private (DP) training protects individual examples by adding noise to gradients, but the injected noise interacts nontrivially with adaptive optimizers. Recent DP me…