8 citations · 12 across the 7 of their papers we have counts for
1 paper · 1 filter
Zhanhong Jiang, Aditya Balu, Sin Yong Tan +3
In this paper, we investigate the popular deep learning optimization routine, Adam, from the perspective of statistical moments. While Adam is an adaptive lower-order moment based…