7.1k citations · 9.2k across the 24 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
cs.NE2016★ 100 cited
Highway and Residual Networks learn Unrolled Iterative Estimation
Klaus Greff, Rupesh K. Srivastava, Jürgen Schmidhuber
The past year saw the introduction of new architectures such as Highway networks and Residual networks which, for the first time, enabled the training of feedforward networks with…
cs.LG2016
Recurrent Highway Networks
Julian Georg Zilly, Rupesh Kumar Srivastava, Jan Koutník +1
Many sequential processing tasks require complex nonlinear transition functions from one step to the next. However, recurrent neural networks with 'deep' transition functions remai…