674 citations · 2.2k across the 8 of their papers we have counts for
3 papers · 1 filter
A Flexible Approach to Automated RNN Architecture Generation
Martin Schrimpf, Stephen Merity, James Bradbury +1
The process of designing neural architectures requires expert knowledge and extensive trial and error. While automated architecture search may simplify these requirements, the recu…
Regularizing and Optimizing LSTM Language Models
Stephen Merity, Nitish Shirish Keskar, Richard Socher
Recurrent neural networks (RNNs), such as long short-term memory networks (LSTMs), serve as a fundamental building block for many sequence learning tasks, including machine transla…
Revisiting Activation Regularization for Language RNNs
Stephen Merity, Bryan McCann, Richard Socher
Recurrent neural networks (RNNs) serve as a fundamental building block for many sequence tasks across natural language processing. Recent research has focused on recurrent dropout…