12 citations · 25 across the 15 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 1 cited
Extending AdamW by Leveraging Its Second Moment and Magnitude
Guoqiang Zhang, Niwa Kenta, W. Bastiaan Kleijn
Recent work [4] analyses the local convergence of Adam in a neighbourhood of an optimal solution for a twice-differentiable function. It is found that the learning rate has to be s…
cs.DC2021
Revisiting the Primal-Dual Method of Multipliers for Optimisation over Centralised Networks
Guoqiang Zhang, Kenta Niwa, W. Bastiaan Kleijn
The primal-dual method of multipliers (PDMM) was originally designed for solving a decomposable optimisation problem over a general network. In this paper, we revisit PDMM for opti…