When Models Manipulate Manifolds: The Geometry of a Counting Task

Wes Gurnee, Emmanuel Ameisen, Isaac Kauvar +4

Language models can perceive visual properties of text despite receiving only sequences of tokens-we mechanistically investigate how Claude 3.5 Haiku accomplishes one such task: li…