HAIR: Head-mounted AR Intention Recognition

Abstract

Human teams exhibit both implicit and explicit intention sharing. To further development of human-robot collaboration, intention recognition is crucial on both sides. Present approaches rely on a vast sensor suite on and around the robot to achieve intention recognition. This relegates intuitive human-robot collaboration purely to such bulky systems, which are inadequate for large-scale, real-world scenarios due to their complexity and cost. In this paper we propose an intention recognition system that is based purely on a portable head-mounted display. In addition robot intention visualisation is also supported. We present experiments to show the quality of our human goal estimation component and some basic interactions with an industrial robot. HAIR should raise the quality of interaction between robots and humans, instead of such interactions raising the hair on the necks of the human coworkers.

arXiv commentAs accepted to the 4th Virtual, Augmented and Mixed reality Human-robot interaction workshop (VAM-HRI), HRI 2021

References in corpus (4)

• YOLOv4: Optimal Speed and Accuracy of Object Detection
• Human Intention Estimation based on Hidden Markov Model Motion Validation for Safe Flexible Robotized Warehouses
• Referencing between a Head-Mounted Device and Robotic Manipulators
• Human Intention Recognition for Human Aware Planning in Integrated Warehouse Systems