Learning Sense-Specific Static Embeddings using Contextualised Word Embeddings as a Proxy

Yi Zhou, Danushka Bollegala

Contextualised word embeddings generated from Neural Language Models (NLMs), such as BERT, represent a word with a vector that considers the semantics of the target word as well it…