Attention's Gravitational Field:A Power-Law Interpretation of Positional Correlation

Edward Zhang

This paper explores the underlying principles of positional relationships and encodings within Large Language Models (LLMs) and introduces the concept of the Attention Gravitationa…