2 papers
cs.LG2018
Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations
Qianxiao Li, Cheng Tai, Weinan E
We develop the mathematical foundations of the stochastic modified equations (SME) framework for analyzing the dynamics of stochastic gradient algorithms, where the latter is appro…
math.OC2018
A Mean-Field Optimal Control Formulation of Deep Learning
Weinan E, Jiequn Han, Qianxiao Li
Recent work linking deep neural networks and dynamical systems opened up new avenues to analyze deep learning. In particular, it is observed that new insights can be obtained by re…