Algorithmic Primitives and Compositional Geometry of Reasoning in Language Models

Samuel Lippl, Thomas McGee, Kimberly Lopez +5

How do latent and inference time computations enable large language models (LLMs) to solve multi-step reasoning? We introduce a framework for tracing and steering algorithmic primi…