86 citations · 333 across the 21 of their papers we have counts for
4 papers · 1 filter
On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime
Zhiyan Ding, Shi Chen, Qin Li +1
Finding the optimal configuration of parameters in ResNet is a nonconvex minimization problem, but first-order methods nevertheless find the global optimum in the overparameterized…
A reduced order Schwarz method for nonlinear multiscale elliptic equations based on two-layer neural networks
Shi Chen, Zhiyan Ding, Qin Li +1
Neural networks are powerful tools for approximating high dimensional data that have been used in many contexts, including solution of partial differential equations (PDEs). We des…
Overparameterization of deep ResNet: zero loss and mean-field analysis
Zhiyan Ding, Shi Chen, Qin Li +1
Finding parameters in a deep neural network (NN) that fit training data is a nonconvex optimization problem, but a basic first-order optimization method (gradient descent) finds a…
Constrained Ensemble Langevin Monte Carlo
Zhiyan Ding, Qin Li
The classical Langevin Monte Carlo method looks for samples from a target distribution by descending the samples along the gradient of the target distribution. The method enjoys a…