Emergent Response Planning in LLMs

Zhichen Dong, Zhanhui Zhou, Zhixuan Liu +2

In this work, we argue that large language models (LLMs), though trained to predict only the next token, exhibit emergent planning behaviors: $\textbf{their hidden representations…