Slim Embedding Layers for Recurrent Neural Language Models

Zhongliang Li, Raymond Kulhanek, Shaojun Wang +2

Recurrent neural language models are the state-of-the-art models for language modeling. When the vocabulary size is large, the space taken to store the model parameters becomes the…