Tao Sun

most citedOverview of AI and Communication for 6G Network: Fundamentals, Challenges, and Future Research Opportunities

198 citations · 198 across the 3 of their papers we have counts for

collaborators

Showing cs.LGShow all

2 papers · 1 filter

cs.LG2024

Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration

Tao Sun, Xinwang Liu, Kun Yuan

Gradient clipping has long been considered essential for ensuring the convergence of Stochastic Gradient Descent (SGD) in the presence of heavy-tailed gradient noise. In this paper…

cs.LG2024

Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to $K$ -Level Stochastic Optimizations

Xiaokang Pan, Xingyu Li, Jin Liu +4

STOchastic Recursive Momentum (STORM)-based algorithms have been widely developed to solve one to $K$ -level ( $K \geq 3$ ) stochastic optimization problems. Specifically, they use es…

Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration

Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to K-Level Stochastic Optimizations

Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to $K$ -Level Stochastic Optimizations