37 citations · 54 across the 2 of their papers we have counts for
2 papers
cs.LG2019★ 37 cited
On the Noisy Gradient Descent that Generalizes as SGD
Jingfeng Wu, Wenqing Hu, Haoyi Xiong +3
The gradient noise of SGD is considered to play a central role in the observed strong generalization abilities of deep learning. While past studies confirm that the magnitude and t…
stat.ML2018★ 17 cited
Neural Control Variates for Variance Reduction
Ruosi Wan, Mingjun Zhong, Haoyi Xiong +1
In statistics and machine learning, approximation of an intractable integration is often achieved by using the unbiased Monte Carlo estimator, but the variances of the estimation a…