78 citations · 191 across the 19 of their papers we have counts for
Showing 2019Show all
2 papers · 1 filter
cs.LG2019★ 38 cited
Limitations of the Empirical Fisher Approximation for Natural Gradient Descent
Frederik Kunstner, Lukas Balles, Philipp Hennig
Natural gradient descent, which preconditions a gradient descent update with the Fisher information matrix of the underlying statistical model, is a way to capture partial second-o…
cs.LG2019★ 6 cited
DeepOBS: A Deep Learning Optimizer Benchmark Suite
Frank Schneider, Lukas Balles, Philipp Hennig
Because the choice and tuning of the optimizer affects the speed, and ultimately the performance of deep learning, there is significant past and recent research in this area. Yet,…