30 citations · 69 across the 9 of their papers we have counts for
Showing stat.MLShow all
2 papers · 1 filter
stat.ML2020★ 6 cited
Spherical Motion Dynamics: Learning Dynamics of Neural Network with Normalization, Weight Decay, and SGD
Ruosi Wan, Zhanxing Zhu, Xiangyu Zhang +1
In this work, we comprehensively reveal the learning dynamics of neural network with normalization, weight decay (WD), and SGD (with momentum), named as Spherical Motion Dynamics (…
stat.ML2018★ 17 cited
Neural Control Variates for Variance Reduction
Ruosi Wan, Mingjun Zhong, Haoyi Xiong +1
In statistics and machine learning, approximation of an intractable integration is often achieved by using the unbiased Monte Carlo estimator, but the variances of the estimation a…