Topology of Word Embeddings: Singularities Reflect Polysemy

Alexander Jakubowski, Milica Gašić, Marcus Zibrowius

The manifold hypothesis suggests that word vectors live on a submanifold within their ambient vector space. We argue that we should, more accurately, expect them to live on a pinch…