Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces
arXiv:2203.03254 · doi:10.1145/3491102.3517719
Abstract
This paper contributes to a taxonomy of augmented reality and robotics based on a survey of 460 research papers. Augmented and mixed reality (AR/MR) have emerged as a new way to enhance human-robot interaction (HRI) and robotic interfaces (e.g., actuated and shape-changing interfaces). Recently, an increasing number of studies in HCI, HRI, and robotics have demonstrated how AR enables better interactions between people and robots. However, often research remains focused on individual explorations and key design strategies, and research questions are rarely analyzed systematically. In this paper, we synthesize and categorize this research field in the following dimensions: 1) approaches to augmenting reality; 2) characteristics of robots; 3) purposes and benefits; 4) classification of presented information; 5) design components and strategies for visual augmentation; 6) interaction techniques and modalities; 7) application domains; and 8) evaluation strategies. We formulate key challenges and opportunities to guide and inform future research in AR and robotics.
arXiv commentCHI 2022
References in corpus (6)
- ShapeBots: Shape-changing Swarm Robots
- RoomShift: Room-scale Dynamic Haptics for VR with Furniture-moving Swarm Robots
- Explainable AI for Robot Failures: Generating Explanations that Improve User Assistance in Fault Recovery
- RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic Sketching
- Expressive Robot Motion Timing
- Mobile Delivery Robots: Mixed Reality-Based Simulation Relying on ROS and Unity 3D
Cited by in corpus (17)
- How to Communicate Robot Motion Intent: A Scoping Review
- Sketched Reality: Sketching Bi-Directional Interactions Between Virtual and Physical Worlds with AR and Actuated Tangible UI
- HoloBots: Augmenting Holographic Telepresence with Mobile Robots for Tangible Remote Collaboration in Mixed Reality
- Vision-Based Multimodal Interfaces: A Survey and Taxonomy for Enhanced Context-Aware System Design
- Towards Massive Interaction with Generalist Robotics: A Systematic Review of XR-enabled Remote Human-Robot Interaction Systems
- Extended-XRI Body Interfaces for Hyper-Connected Metaverse Environments
- AdaptiX -- A Transitional XR Framework for Development and Evaluation of Shared Control Applications in Assistive Robotics
- UltraBots: Large-Area Mid-Air Haptics for VR with Robotically Actuated Ultrasound Transducers
- RAMPA: Robotic Augmented Reality for Machine Programming by DemonstrAtion
- Exploring the Design Space of Extra-Linguistic Expression for Robots
- Extended Reality for Enhanced Human-Robot Collaboration: a Human-in-the-Loop Approach
- ARTHUR: Authoring Human-Robot Collaboration Processes with Augmented Reality using Hybrid User Interfaces
- ExplorAR: Assisting Older Adults to Learn Smartphone Apps through AR-powered Trial-and-Error with Interactive Guidance
- Set the Stage: Enabling Storytelling with Multiple Robots through Roleplaying Metaphors
- Visual Attention Based Cognitive Human-Robot Collaboration for Pedicle Screw Placement in Robot-Assisted Orthopedic Surgery
- HapticLever: Kinematic Force Feedback using a 3D Pantograph
- corobos: A Design for Mobile Robots Enabling Cooperative Transitions between Table and Wall Surfaces