9 citations · 13 across the 4 of their papers we have counts for
Showing 2020Show all
2 papers · 1 filter
stat.ML2020
When Does Preconditioning Help or Hurt Generalization?
Shun-ichi Amari, Jimmy Ba, Roger Grosse +5
While second order optimizers such as natural gradient descent (NGD) often speed up optimization, their effect on generalization has been called into question. This work presents a…
cs.LG2020
Scalable Gradients for Stochastic Differential Equations
Xuechen Li, Ting-Kam Leonard Wong, Ricky T. Q. Chen +1
The adjoint sensitivity method scalably computes gradients of solutions to ordinary differential equations. We generalize this method to stochastic differential equations, allowing…