On the Emergence of Linear Analogies in Word Embeddings

Daniel J. Korchinski, Dhruva Karkada, Yasaman Bahri +1

Models such as Word2Vec and GloVe construct word embeddings based on the co-occurrence probability $P(i,j)$ of words $i$ and $j$ in text corpora. The resulting vectors $W_i$ not on…