Invariant Reasoning Directions in Latent Trajectories of Language Models

Arun Vignesh Malarkkan, Manan Roy Choudhury, Utkarsh Byahut +3

Latent reasoning models perform multi-step inference directly in hidden-state space, yet the structure of these latent reasoning trajectories remains poorly understood. We show tha…