3 papers
cs.NI2024
Overview of AI and Communication for 6G Network: Fundamentals, Challenges, and Future Research Opportunities
Qimei Cui, Xiaohu You, Ni Wei +22
With the growing demand for seamless connectivity and intelligent communication, the integration of artificial intelligence (AI) and sixth-generation (6G) communication networks ha…
cs.LG2024
Revisiting Gradient Normalization and Clipping for Nonconvex SGD under Heavy-Tailed Noise: Necessity, Sufficiency, and Acceleration
Tao Sun, Xinwang Liu, Kun Yuan
Gradient clipping has long been considered essential for ensuring the convergence of Stochastic Gradient Descent (SGD) in the presence of heavy-tailed gradient noise. In this paper…
cs.LG2024
Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to -Level Stochastic Optimizations
Xiaokang Pan, Xingyu Li, Jin Liu +4
STOchastic Recursive Momentum (STORM)-based algorithms have been widely developed to solve one to -level () stochastic optimization problems. Specifically, they use es…