20 citations · 84 across the 25 of their papers we have counts for
4 papers · 1 filter
A Unified Analysis for Finite Weight Averaging
Peng Wang, Li Shen, Zerui Tao +3
Averaging iterations of Stochastic Gradient Descent (SGD) have achieved empirical success in training deep learning models, such as Stochastic Weight Averaging (SWA), Exponential M…
Stability and Generalization for Distributed SGDA
Miaoxi Zhu, Yan Sun, Li Shen +2
Minimax optimization is gaining increasing attention in modern machine learning applications. Driven by large-scale models and massive volumes of data collected from edge devices,…
A-FedPD: Aligning Dual-Drift is All Federated Primal-Dual Learning Needs
Yan Sun, Li Shen, Dacheng Tao
As a popular paradigm for juggling data privacy and collaborative training, federated learning (FL) is flourishing to distributively process the large scale of heterogeneous datase…
Convergent Differential Privacy Analysis for General Federated Learning
Yan Sun, Qixin Zhang, Li Shen +1
The powerful cooperation of federated learning (FL) and differential privacy~(DP) provides a promising paradigm for the large-scale private clients. However, existing analyses in F…