Compact Real-time avoidance on a Humanoid Robot for Human-robot Interaction

Abstract

With robots leaving factories and entering less controlled domains, possibly sharing the space with humans, safety is paramount and multimodal awareness of the body surface and the surrounding environment is fundamental. Taking inspiration from peripersonal space representations in humans, we present a framework on a humanoid robot that dynamically maintains such a protective safety zone, composed of the following main components: (i) a human 2D keypoints estimation pipeline employing a deep learning based algorithm, extended here into 3D using disparity; (ii) a distributed peripersonal space representation around the robot's body parts; (iii) a reaching controller that incorporates all obstacles entering the robot's safety zone on the fly into the task. Pilot experiments demonstrate that an effective safety margin between the robot's and the human's body parts is kept. The proposed solution is flexible and versatile since the safety zone around individual robot and human body parts can be selectively modulated---here we demonstrate stronger avoidance of the human head compared to rest of the body. Our system works in real time and is self-contained, with no external sensory equipment and use of onboard cameras only.

References in corpus (3)

• A Flexible and Robust Large Scale Capacitive Tactile System for Robots
• Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
• Enabling Depth-driven Visual Attention on the iCub Humanoid Robot: Instructions for Use and New Perspectives

Cited by in corpus (7)

• Safe physical HRI: Toward a unified treatment of speed and separation monitoring together with power and force limiting
• Human keypoint detection for close proximity human-robot interaction
• Should a small robot have a small personal space? Investigating personal spatial zones and proxemic behavior in human-robot interaction
• Toward safe separation distance monitoring from RGB-D sensors in human-robot interaction
• Robotic self-representation improves manipulation skills and transfer learning
• GenTact Toolbox: A Computational Design Pipeline to Procedurally Generate Context-Driven 3D Printed Whole-Body Artificial Skins
• Safety of human-robot interaction through tactile sensors and peripersonal space representations