Squashed Shifted PMI Matrix: Bridging Word Embeddings and Hyperbolic Spaces

Zhenisbek Assylbekov, Alibi Jangeldin

We show that removing sigmoid transformation in the skip-gram with negative sampling (SGNS) objective does not harm the quality of word vectors significantly and at the same time i…