45 citations · 126 across the 10 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
stat.ML2017★ 21 cited
Wider and Deeper, Cheaper and Faster: Tensorized LSTMs for Sequence Learning
Zhen He, Shaobing Gao, Liang Xiao +3
Long Short-Term Memory (LSTM) is a popular approach to boosting the ability of Recurrent Neural Networks to store longer term temporal information. The capacity of an LSTM network…
stat.ML2017★ 35 cited
Practical Gauss-Newton Optimisation for Deep Learning
Aleksandar Botev, Hippolyt Ritter, David Barber
We present an efficient block-diagonal ap- proximation to the Gauss-Newton matrix for feedforward neural networks. Our result- ing algorithm is competitive against state- of-the-ar…