Skip-gram Language Modeling Using Sparse Non-negative Matrix Probability Estimation

Noam Shazeer, Joris Pelemans, Ciprian Chelba

We present a novel family of language model (LM) estimation techniques named Sparse Non-negative Matrix (SNM) estimation. A first set of experiments empirically evaluating it on th…