61 citations · 72 across the 7 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.LG2022★ 3 cited
Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks
Xin Liu, Wei Tao, Wei Li +3
Due to its simplicity and efficiency, the first-order gradient method has been extensively employed in training neural networks. Although the optimization problem of the neural net…
cs.LG2022★ 7 cited
FedSSO: A Federated Server-Side Second-Order Optimization Algorithm
Xin Ma, Renyi Bao, Jinpeng Jiang +5
In this work, we propose FedSSO, a server-side second-order optimization method for federated learning (FL). In contrast to previous works in this direction, we employ a server-sid…
cs.LG2022
A Convergence Analysis of Nesterov's Accelerated Gradient Method in Training Deep Linear Neural Networks
Xin Liu, Wei Tao, Zhisong Pan
Momentum methods, including heavy-ball~(HB) and Nesterov's accelerated gradient~(NAG), are widely used in training neural networks for their fast convergence. However, there is a l…