1.3k citations · 2.9k across the 32 of their papers we have counts for
Showing 2015Show all
2 papers · 1 filter
cs.NE2015★ 27 cited
Regularizing RNNs by Stabilizing Activations
David Krueger, Roland Memisevic
We stabilize the activations of Recurrent Neural Networks (RNNs) by penalizing the squared distance between successive hidden states' norms. This penalty term is an effective regul…
cs.LG2015
Testing Visual Attention in Dynamic Environments
Philip Bachman, David Krueger, Doina Precup
We investigate attention as the active pursuit of useful information. This contrasts with attention as a mechanism for the attenuation of irrelevant information. We also consider t…