Incremental Sense Weight Training for the Interpretation of Contextualized Word Embeddings

Xinyi Jiang, Zhengzhe Yang, Jinho D. Choi

We present a novel online algorithm that learns the essence of each dimension in word embeddings by minimizing the within-group distance of contextualized embedding groups. Three s…