198 citations · 379 across the 15 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 2 cited
On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime
Zhiyan Ding, Shi Chen, Qin Li +1
Finding the optimal configuration of parameters in ResNet is a nonconvex minimization problem, but first-order methods nevertheless find the global optimum in the overparameterized…
cs.LG2021
Overparameterization of deep ResNet: zero loss and mean-field analysis
Zhiyan Ding, Shi Chen, Qin Li +1
Finding parameters in a deep neural network (NN) that fit training data is a nonconvex optimization problem, but a basic first-order optimization method (gradient descent) finds a…