4 papers
Accelerated Decentralized Stochastic Gradient Descent for Strongly Convex Optimization
Ming Sun, Kun Yuan
Decentralized stochastic optimization is a fundamental paradigm for large-scale learning over networks, where agents communicate only with their neighbors and no central coordinato…
On the Escaping Efficiency of Distributed Adversarial Training Algorithms
Ying Cao, Kun Yuan, Ali H. Sayed
Adversarial training has been widely studied in recent years due to its role in improving model robustness against adversarial attacks. This paper focuses on comparing different di…
On the Trade-off between Flatness and Optimization in Distributed Learning
Ying Cao, Zhaoxian Wu, Kun Yuan +1
This paper proposes a theoretical framework to evaluate and compare the performance of stochastic gradient algorithms for distributed learning in relation to their behavior around…
Diffusion Learning with Partial Agent Participation and Local Updates
Elsa Rizk, Kun Yuan, Ali H. Sayed
Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its imme…