TransDrift: Modeling Word-Embedding Drift using Transformer

Nishtha Madaan, Prateek Chaudhury, Nishant Kumar +1

In modern NLP applications, word embeddings are a crucial backbone that can be readily shared across a number of tasks. However as the text distributions change and word semantics…