3.7k citations · 11.6k across the 43 of their papers we have counts for
3 papers · 1 filter
NN-grams: Unifying neural network and n-gram language models for Speech Recognition
Babak Damavandi, Shankar Kumar, Noam Shazeer +1
We present NN-grams, a novel, hybrid language model integrating n-grams and neural networks (NN) for speech recognition. The model takes as input both word histories as well as n-g…
Exploring the Limits of Language Modeling
Rafal Jozefowicz, Oriol Vinyals, Mike Schuster +2
In this work we explore recent advances in Recurrent Neural Networks for large scale Language Modeling, a task central to language understanding. We extend current models to deal w…
Swivel: Improving Embeddings by Noticing What's Missing
Noam Shazeer, Ryan Doherty, Colin Evans +1
We present Submatrix-wise Vector Embedding Learner (Swivel), a method for generating low-dimensional feature embeddings from a feature co-occurrence matrix. Swivel performs approxi…