Word Meanings in Transformer Language Models

Jumbly Grindrod, Peter Grindrod

We investigate how word meanings are represented in the transformer language models. Specifically, we focus on whether transformer models employ something analogous to a lexical st…