AlgoTrace: Algorithmic Primitives and Compositional Geometry of Reasoning in Language Models

Samuel Lippl, Thomas McGee, Kimberly Lopez +5

How do inference time and latent computations enable large language models (LLMs) to solve multi-step reasoning problems? We introduce AlgoTrace, a framework for tracing and steeri…