On the Persistent Effects of Lexicality in Large Language Models

Hammad Rizwan, Muhammad Umair Haider, Nishant Subramani +3

Representations extracted from large language models (LLMs) play an important role in many downstream applications. However, the structure of these representations is often influen…