Large Language Models Can Take False First Steps at Inference-time Planning

Haijiang Yan, Jian-Qiao Zhu, Adam Sanborn

Large language models (LLMs) have been shown to acquire sequence-level planning abilities during training, yet their planning behavior exhibited at inference time often appears sho…