A Measure-Theoretic Analysis of Reasoning in Transformers: Structural Generalization and Approximation Limits

Yuyang Zhang, Yifu Zhang, Xuehai Zhou +1

Scaling laws for reasoning in large language models (LLMs) are well documented, but little theory explains their out-of-distribution (OOD) generalization. We formalize reasoning wi…