2 citations · 2 across the 4 of their papers we have counts for
Showing 2018Show all
3 papers · 1 filter
cs.LG2018
Combining Natural Gradient with Hessian Free Methods for Sequence Training
Adnan Haider, P. C. Woodland
This paper presents a new optimisation approach to train Deep Neural Networks (DNNs) with discriminative sequence criteria. At each iteration, the method combines information from…
cs.CL2018
Sequence Training of DNN Acoustic Models With Natural Gradient
Adnan Haider, Philip C. Woodland
Deep Neural Network (DNN) acoustic models often use discriminative sequence training that optimises an objective function that better approximates the word error rate (WER) than fr…
cs.LG2018★ 2 cited
A Common Framework for Natural Gradient and Taylor based Optimisation using Manifold Theory
Adnan Haider
This technical report constructs a theoretical framework to relate standard Taylor approximation based optimisation methods with Natural Gradient (NG), a method which is Fisher eff…