Streaming Word Embeddings with the Space-Saving Algorithm

Chandler May, Kevin Duh, Benjamin Van Durme +1

We develop a streaming (one-pass, bounded-memory) word embedding algorithm based on the canonical skip-gram with negative sampling algorithm implemented in word2vec. We compare our…