36 citations · 186 across the 15 of their papers we have counts for
4 papers · 1 filter
Distributed SGD Generalizes Well Under Asynchrony
Jayanth Regatti, Gaurav Tendolkar, Yi Zhou +2
The performance of fully synchronized distributed systems has faced a bottleneck due to the big data trend, under which asynchronous distributed systems are becoming a major popula…
Generalization Error Bounds with Probabilistic Guarantee for SGD in Nonconvex Optimization
Yi Zhou, Yingbin Liang, Huishuai Zhang
The success of deep learning has led to a rising interest in the generalization property of the stochastic gradient descent (SGD) method, and stability is one popular approach to s…
Critical Points of Neural Networks: Analytical Forms and Landscape Properties
Yi Zhou, Yingbin Liang
Due to the success of deep learning to solving a variety of challenging machine learning tasks, there is a rising interest in understanding loss functions for training neural netwo…
Characterization of Gradient Dominance and Regularity Conditions for Neural Networks
Yi Zhou, Yingbin Liang
The past decade has witnessed a successful application of deep learning to solving many challenging problems in machine learning and artificial intelligence. However, the loss func…