Learning the Dimensionality of Word Embeddings

Eric Nalisnick, Sachin Ravi

We describe a method for learning word embeddings with data-dependent dimensionality. Our Stochastic Dimensionality Skip-Gram (SD-SG) and Stochastic Dimensionality Continuous Bag-o…