Are there identifiable structural parts in the sentence embedding whole?

Vivi Nastase, Paola Merlo

Sentence embeddings from transformer models encode in a fixed length vector much linguistic information. We explore the hypothesis that these embeddings consist of overlapping laye…