Scaling Recurrent Neural Network Language Models

Will Williams, Niranjani Prasad, David Mrva +2

This paper investigates the scaling properties of Recurrent Neural Network Language Models (RNNLMs). We discuss how to train very large RNNs on GPUs and address the questions of ho…