82 citations · 212 across the 6 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.LG2018★ 38 cited
Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations
Qianxiao Li, Cheng Tai, Weinan E
We develop the mathematical foundations of the stochastic modified equations (SME) framework for analyzing the dynamics of stochastic gradient algorithms, where the latter is appro…
math.OC2018★ 72 cited
A Mean-Field Optimal Control Formulation of Deep Learning
Weinan E, Jiequn Han, Qianxiao Li
Recent work linking deep neural networks and dynamical systems opened up new avenues to analyze deep learning. In particular, it is observed that new insights can be obtained by re…