Internal Chain-of-Thought: Empirical Evidence for Layer-wise Subtask Scheduling in LLMs

Zhipeng Yang, Junzhuo Li, Siyu Xia +1

We show that large language models (LLMs) exhibit an $\text{internal chain-of-thought}$: they sequentially decompose and execute composite tasks layer-by-layer. Two claims ground…