4 citations · 12 across the 24 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
stat.ML2022★ 4 cited
The alignment property of SGD noise and how it helps select flat minima: A stability analysis
Lei Wu, Mingze Wang, Weijie Su
The phenomenon that stochastic gradient descent (SGD) favors flat minima has played a critical role in understanding the implicit regularization of SGD. In this paper, we provide a…
cs.LG2022★ 3 cited
Generalization Error Bounds for Deep Neural Networks Trained by SGD
Mingze Wang, Chao Ma
Generalization error bounds for deep neural networks trained by stochastic gradient descent (SGD) are derived by combining a dynamical control of an appropriate parameter norm and…
cs.LG2022★ 1 cited
Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks
Mingze Wang, Chao Ma
The convergence of GD and SGD when training mildly parameterized neural networks starting from random initialization is studied. For a broad range of models and loss functions, inc…