Creative Problem Solving in Artificially Intelligent Agents: A Survey and Framework

Abstract

Creative Problem Solving (CPS) is a sub-area within Artificial Intelligence (AI) that focuses on methods for solving off-nominal, or anomalous problems in autonomous systems. Despite many advancements in planning and learning, resolving novel problems or adapting existing knowledge to a new context, especially in cases where the environment may change in unpredictable ways post deployment, remains a limiting factor in the safe and useful integration of intelligent systems. The emergence of increasingly autonomous systems dictates the necessity for AI agents to deal with environmental uncertainty through creativity. To stimulate further research in CPS, we present a definition and a framework of CPS, which we adopt to categorize existing AI methods in this field. Our framework consists of four main components of a CPS problem, namely, 1) problem formulation, 2) knowledge representation, 3) method of knowledge manipulation, and 4) method of evaluation. We conclude our survey with open research questions, and suggested directions for the future.

46 pages (including appendix), 17 figures, under submission at Journal of Artificial Intelligence Research (JAIR)

References in corpus (11)

• PDDL2.1: An Extension to PDDL for Expressing Temporal Planning Domains
• Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutions
• Neurosymbolic AI: The 3rd Wave
• Autocurricula and the Emergence of Innovation from Social Interaction: A Manifesto for Multi-Agent Intelligence Research
• Skill Learning by Autonomous Robotic Playing using Active Learning and Creativity
• Generalization to New Actions in Reinforcement Learning
• KETO: Learning Keypoint Representations for Tool Manipulation
• Tool Substitution with Shape and Material Reasoning Using Dual Neural Networks
• Tool Macgyvering: A Novel Framework for Combining Tool Substitution and Construction
• SPOTTER: Extending Symbolic Planning Operators through Targeted Reinforcement Learning
• RAPid-Learn: A Framework for Learning to Recover for Handling Novelties in Open-World Environments