1.6k citations · 11.3k across the 73 of their papers we have counts for
4 papers · 2 filters
Time-Dependent Representation for Neural Event Sequence Prediction
Yang Li, Nan Du, Samy Bengio
Existing sequence prediction methods are mostly concerned with time-independent sequences, in which the actual time span between events is irrelevant and the distance between event…
Device Placement Optimization with Reinforcement Learning
Azalia Mirhoseini, Hieu Pham, Quoc V. Le +7
The past few years have witnessed a growth in size and computational requirements for training and inference with neural networks. Currently, a common approach to address these req…
Learning to Remember Rare Events
Łukasz Kaiser, Ofir Nachum, Aurko Roy +1
Despite recent advances, memory-augmented deep neural networks are still limited when it comes to life-long and one-shot learning, especially in remembering rare events. We present…
Sharp Minima Can Generalize For Deep Nets
Laurent Dinh, Razvan Pascanu, Samy Bengio +1
Despite their overwhelming capacity to overfit, deep learning architectures tend to generalize relatively well to unseen data, allowing them to be deployed in practice. However, ex…