306 citations · 438 across the 18 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.LG2020
The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks
Bohan Wang, Qi Meng, Wei Chen +1
Despite their overwhelming capacity to overfit, deep neural networks trained by specific optimization algorithms tend to generalize well to unseen data. Recently, researchers expla…
cs.DS2020
Constructing Basis Path Set by Eliminating Path Dependency
Juanping Zhu, Qi Meng, Wei Chen +2
The way the basis path set works in neural network remains mysterious, and the generalization of newly appeared G-SGD algorithm to more practical network is hindered. The Basis Pat…
cs.LG2020
Dynamic of Stochastic Gradient Descent with State-Dependent Noise
Qi Meng, Shiqi Gong, Wei Chen +2
Stochastic gradient descent (SGD) and its variants are mainstream methods to train deep neural networks. Since neural networks are non-convex, more and more works study the dynamic…