Understanding and Enhancing the Planning Capability of Language Models via Multi-Token Prediction

Qimin Zhong, Hao Liao, Siwei Wang +4

Large Language Models (LLMs) have achieved impressive performance across diverse tasks but continue to struggle with learning transitive relations, a cornerstone for complex planni…