86 citations · 92 across the 2 of their papers we have counts for
2 papers
cs.LG2019★ 6 cited
Bayesian Optimized Continual Learning with Attention Mechanism
Ju Xu, Jin Ma, Zhanxing Zhu
Though neural networks have achieved much progress in various applications, it is still highly challenging for them to learn from a continuous stream of tasks without forgetting. C…
stat.ML2018★ 86 cited
The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Sharp Minima and Regularization Effects
Zhanxing Zhu, Jingfeng Wu, Bing Yu +2
Understanding the behavior of stochastic gradient descent (SGD) in the context of deep neural networks has raised lots of concerns recently. Along this line, we study a general for…