Sketching Robot Programs On the Fly
arXiv:2302.03088 · doi:10.1145/3568162.3576991
Abstract
Service robots for personal use in the home and the workplace require end-user development solutions for swiftly scripting robot tasks as the need arises. Many existing solutions preserve ease, efficiency, and convenience through simple programming interfaces or by restricting task complexity. Others facilitate meticulous task design but often do so at the expense of simplicity and efficiency. There is a need for robot programming solutions that reconcile the complexity of robotics with the on-the-fly goals of end-user development. In response to this need, we present a novel, multimodal, and on-the-fly development system, Tabula. Inspired by a formative design study with a prototype, Tabula leverages a combination of spoken language for specifying the core of a robot task and sketching for contextualizing the core. The result is that developers can script partial, sloppy versions of robot programs to be completed and refined by a program synthesizer. Lastly, we demonstrate our anticipated use cases of Tabula via a set of application scenarios.
arXiv commentAccepted at HRI '23, March 13-16, 2023, Stockholm, Sweden
References in corpus (7)
- Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars
- Deep Recurrent Quantization for Generating Sequential Binary Codes
- Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval
- Improving Grounded Natural Language Understanding through Human-Robot Dialog
- Situated Live Programming for Human-Robot Collaboration
- Neural Semantic Parsing with Anonymization for Command Understanding in General-Purpose Service Robots
- Verbal Programming of Robot Behavior
Cited by in corpus (6)
- Generative Expressive Robot Behaviors using Large Language Models
- REX: Designing User-centered Repair and Explanations to Address Robot Failures
- Programming-by-Demonstration for Long-Horizon Robot Tasks
- Goal-Oriented End-User Programming of Robots
- Understanding On-the-Fly End-User Robot Programming
- GenComUI: Exploring Generative Visual Aids as Medium to Support Task-Oriented Human-Robot Communication