LLM+P: Empowering Large Language Models with Optimal Planning Proficiency

Abstract

Large language models (LLMs) have demonstrated remarkable zero-shot generalization abilities: state-of-the-art chatbots can provide plausible answers to many common questions that arise in daily life. However, so far, LLMs cannot reliably solve long-horizon planning problems. By contrast, classical planners, once a problem is given in a formatted way, can use efficient search algorithms to quickly identify correct, or even optimal, plans. In an effort to get the best of both worlds, this paper introduces LLM+P, the first framework that incorporates the strengths of classical planners into LLMs. LLM+P takes in a natural language description of a planning problem, then returns a correct (or optimal) plan for solving that problem in natural language. LLM+P does so by first converting the language description into a file written in the planning domain definition language (PDDL), then leveraging classical planners to quickly find a solution, and then translating the found solution back into natural language. Along with LLM+P, we define a diverse set of different benchmark problems taken from common planning scenarios. Via a comprehensive set of experiments on these benchmark problems, we find that LLM+P is able to provide optimal solutions for most problems, while LLMs fail to provide even feasible plans for most problems.\footnote{The code and results are publicly available at https://github.com/Cranial-XIX/llm-pddl.git.

Cited by in corpus (9)

• Theory of Mind for Multi-Agent Collaboration via Large Language Models
• On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)
• Deploying and Evaluating LLMs to Program Service Mobile Robots
• CoPAL: Corrective Planning of Robot Actions with Large Language Models
• Theory of Mind abilities of Large Language Models in Human-Robot Interaction : An Illusion?
• FASTNav: Fine-tuned Adaptive Small-language-models Trained for Multi-point Robot Navigation
• Bootstrapping Cognitive Agents with a Large Language Model
• Visual Graph Question Answering with ASP and LLMs for Language Parsing
• LLM-GROP: Visually Grounded Robot Task and Motion Planning with Large Language Models