Mechanistic Decomposition of Sentence Representations

Matthieu Tehenan, Vikram Natarajan, Jonathan Michala +2

Sentence embeddings are central to modern NLP and AI systems, yet little is known about their internal structure. While we can compare these embeddings using measures such as cosin…