A Statistical Physics of Language Model Reasoning

Jack David Carson, Amir Reisizadeh

Transformer LMs show emergent reasoning that resists mechanistic understanding. We offer a statistical physics framework for continuous-time chain-of-thought reasoning dynamics. We…