4 citations · 4 across the 1 of their papers we have counts for
2 papers
math.OC2020★ 4 cited
Non-Convex Optimization via Non-Reversible Stochastic Gradient Langevin Dynamics
Yuanhan Hu, Xiaoyu Wang, Xuefeng Gao +2
Stochastic Gradient Langevin Dynamics (SGLD) is a powerful algorithm for optimizing a non-convex objective, where a controlled and properly scaled Gaussian noise is added to the st…
cs.LG2020
Fractional moment-preserving initialization schemes for training deep neural networks
Mert Gurbuzbalaban, Yuanhan Hu
A traditional approach to initialization in deep neural networks (DNNs) is to sample the network weights randomly for preserving the variance of pre-activations. On the other hand,…