Trajectory Geometry of Transformer Representations Across Layers

Vishal Pandey, Gopal Singh, Yacine Mahdid

Understanding how transformer representations evolve across layers, not merely what they encode, remains an open problem in mechanistic interpretability. We recast the transformer…