Generative Expressive Robot Behaviors using Large Language Models
arXiv:2401.14673 · doi:10.1145/3610977.3634999
Abstract
People employ expressive behaviors to effectively communicate and coordinate their actions with others, such as nodding to acknowledge a person glancing at them or saying "excuse me" to pass people in a busy corridor. We would like robots to also demonstrate expressive behaviors in human-robot interaction. Prior work proposes rule-based methods that struggle to scale to new communication modalities or social situations, while data-driven methods require specialized datasets for each social situation the robot is used in. We propose to leverage the rich social context available from large language models (LLMs) and their ability to generate motion based on instructions or user preferences, to generate expressive robot motion that is adaptable and composable, building upon each other. Our approach utilizes few-shot chain-of-thought prompting to translate human language instructions into parametrized control code using the robot's available and learned skills. Through user studies and simulation experiments, we demonstrate that our approach produces behaviors that users found to be competent and easy to understand. Supplementary material can be found at https://generative-expressive-motion.github.io/.
References in corpus (4)
Cited by in corpus (7)
- VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots
- To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions
- Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review
- GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication
- Towards an LLM-Based Speech Interface for Robot-Assisted Feeding
- Grounding LLMs For Robot Task Planning Using Closed-loop State Feedback
- RoboCritics: Enabling Reliable End-to-End LLM Robot Programming through Expert-Informed Critics