Some Tokens Behave like Magnets: Revealing Linguistic Organization in the Layers of Language Models

Andrew Liu, Devan Srinivasan, Gerald Penn

We identify a special group of token vectors inside large language models (LLMs), which we term magnetic vectors, that organize the surrounding tokens by either attracting or repel…