PolyLM: Learning about Polysemy through Language Modeling

Alan Ansell, Felipe Bravo-Marquez, Bernhard Pfahringer

To avoid the "meaning conflation deficiency" of word embeddings, a number of models have aimed to embed individual word senses. These methods at one time performed well on tasks su…