Revisiting Skip-Gram Negative Sampling Model with Rectification

Cun Mu, Guang Yang, Zheng Yan

We revisit skip-gram negative sampling (SGNS), one of the most popular neural-network based approaches to learning distributed word representation. We first point out the ambiguity…