77 citations · 233 across the 52 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.LG2019★ 1 cited
On Higher-order Moments in Adam
Zhanhong Jiang, Aditya Balu, Sin Yong Tan +3
In this paper, we investigate the popular deep learning optimization routine, Adam, from the perspective of statistical moments. While Adam is an adaptive lower-order moment based…
cs.LG2019
A Fast Saddle-Point Dynamical System Approach to Robust Deep Learning
Yasaman Esfandiari, Aditya Balu, Keivan Ebrahimi +3
Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms invol…