59 citations · 186 across the 12 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
stat.ML2021★ 1 cited
Structured second-order methods via natural gradient descent
Wu Lin, Frank Nielsen, Mohammad Emtiyaz Khan +1
In this paper, we propose new structured second-order methods and structured adaptive-gradient methods obtained by performing natural-gradient descent on structured parameter space…
stat.ML2021★ 5 cited
Tractable structured natural gradient descent using local parameterizations
Wu Lin, Frank Nielsen, Mohammad Emtiyaz Khan +1
Natural-gradient descent (NGD) on structured parameter spaces (e.g., low-rank covariances) is computationally challenging due to difficult Fisher-matrix computations. We address th…