Latent Planning Emerges with Scale

Michael Hanna, Emmanuel Ameisen

LLMs can perform seemingly planning-intensive tasks, like writing coherent stories or functioning code, without explicitly verbalizing a plan; however, the extent to which they imp…