Back to the Future -- Sequential Alignment of Text Representations

Johannes Bjerva, Wouter Kouw, Isabelle Augenstein

Language evolves over time in many ways relevant to natural language processing tasks. For example, recent occurrences of tokens 'BERT' and 'ELMO' in publications refer to neural n…