Contextualized word senses: from attention to compositionality

Pablo Gamallo

The neural architectures of language models are becoming increasingly complex, especially that of Transformers, based on the attention mechanism. Although their application to nume…