82 citations · 212 across the 6 of their papers we have counts for
Showing cs.LGShow all
3 papers · 1 filter
cs.LG2018★ 38 cited
Stochastic Modified Equations and Dynamics of Stochastic Gradient Algorithms I: Mathematical Foundations
Qianxiao Li, Cheng Tai, Weinan E
We develop the mathematical foundations of the stochastic modified equations (SME) framework for analyzing the dynamics of stochastic gradient algorithms, where the latter is appro…
cs.LG2017★ 82 cited
Maximum Principle Based Algorithms for Deep Learning
Qianxiao Li, Long Chen, Cheng Tai +1
The continuous dynamical system approach to deep learning is explored in order to devise alternative frameworks for training algorithms. Training is recast as a control problem and…
cs.LG2015★ 17 cited
Stochastic modified equations and adaptive stochastic gradient algorithms
Qianxiao Li, Cheng Tai, Weinan E
We develop the method of stochastic modified equations (SME), in which stochastic gradient algorithms are approximated in the weak sense by continuous-time stochastic differential…