538 citations · 2.3k across the 54 of their papers we have counts for
4 papers · 1 filter
Structured second-order methods via natural gradient descent
Wu Lin, Frank Nielsen, Mohammad Emtiyaz Khan +1
In this paper, we propose new structured second-order methods and structured adaptive-gradient methods obtained by performing natural-gradient descent on structured parameter space…
SVRG Meets AdaGrad: Painless Variance Reduction
Benjamin Dubois-Taine, Sharan Vaswani, Reza Babanezhad +2
Variance reduction (VR) methods for finite-sum minimization typically require the knowledge of problem-dependent constants that are often unknown and difficult to estimate. To addr…
Tractable structured natural gradient descent using local parameterizations
Wu Lin, Frank Nielsen, Mohammad Emtiyaz Khan +1
Natural-gradient descent (NGD) on structured parameter spaces (e.g., low-rank covariances) is computationally challenging due to difficult Fisher-matrix computations. We address th…
The pathway elaboration method for mean first passage time estimation in large continuous-time Markov chains with applications to nucleic acid kinetics
Sedigheh Zolaktaf, Frits Dannenberg, Mark Schmidt +2
For predicting the kinetics of nucleic acid reactions, continuous-time Markov chains (CTMCs) are widely used. The rate of a reaction can be obtained through the mean first passage…