Topics in Contextualised Attention Embeddings

Mozhgan Talebpour, Alba Garcia Seco de Herrera, Shoaib Jameel

Contextualised word vectors obtained via pre-trained language models encode a variety of knowledge that has already been exploited in applications. Complementary to these language…