Correspondence Analysis and PMI-Based Word Embeddings: A Comparative Study

Qianqian Qi, Ayoub Bagheri, David J. Hessen +1

Popular word embedding methods such as GloVe and Word2Vec are related to the factorization of the pointwise mutual information (PMI) matrix. In this paper, we establish a formal co…