10 citations · 23 across the 7 of their papers we have counts for
3 papers · 1 filter
Variance-reduced Clipping for Non-convex Optimization
Amirhossein Reisizadeh, Haochuan Li, Subhro Das +1
Gradient clipping is a standard training technique used in deep learning applications such as large-scale language modeling to mitigate exploding gradients. Recent experimental stu…
Byzantine-Robust Federated Linear Bandits
Ali Jadbabaie, Haochuan Li, Jian Qian +1
In this paper, we study a linear bandit optimization problem in a federated setting where a large collection of distributed agents collaboratively learn a common linear bandit mode…
Neural Network Weights Do Not Converge to Stationary Points: An Invariant Measure Perspective
Jingzhao Zhang, Haochuan Li, Suvrit Sra +1
This work examines the deep disconnect between existing theoretical analyses of gradient-based algorithms and the practice of training deep neural networks. Specifically, we provid…