7.1k citations · 9.2k across the 24 of their papers we have counts for
5 papers · 1 filter
Binding via Reconstruction Clustering
Klaus Greff, Rupesh Kumar Srivastava, Jürgen Schmidhuber
Disentangled distributed representations of data are desirable for machine learning, since they are more expressive and can generalize from fewer examples. However, for complex dat…
Training Very Deep Networks
Rupesh Kumar Srivastava, Klaus Greff, Jürgen Schmidhuber
Theoretical and empirical evidence indicates that the depth of neural networks is crucial for their success. However, training becomes more difficult as depth increases, and traini…
Highway Networks
Rupesh Kumar Srivastava, Klaus Greff, Jürgen Schmidhuber
There is plenty of theoretical and empirical evidence that depth of neural networks is a crucial ingredient for their success. However, network training becomes more difficult with…
Joint Learning of Distributed Representations for Images and Texts
Xiaodong He, Rupesh Srivastava, Jianfeng Gao +1
This technical report provides extra details of the deep multimodal similarity model (DMSM) which was proposed in (Fang et al. 2015, arXiv:1411.4952). The model is trained via maxi…
LSTM: A Search Space Odyssey
Klaus Greff, Rupesh Kumar Srivastava, Jan Koutník +2
Several variants of the Long Short-Term Memory (LSTM) architecture for recurrent neural networks have been proposed since its inception in 1995. In recent years, these networks hav…