EWareNet: Emotion Aware Human Intent Prediction and Adaptive Spatial Profile Fusion for Social Robot Navigation

Abstract

We present EWareNet, a novel intent and affect-aware social robot navigation algorithm among pedestrians. Our approach predicts the trajectory-based pedestrian intent from gait sequence, which is then used for intent-guided navigation taking into account social and proxemic constraints. We propose a transformer-based model that works on commodity RGB-D cameras mounted onto a moving robot. Our intent prediction routine is integrated into a mapless navigation scheme and makes no assumptions about the environment of pedestrian motion. Our navigation scheme consists of a novel obstacle profile representation methodology that is dynamically adjusted based on the pedestrian pose, intent, and affect. The navigation scheme is based on a reinforcement learning algorithm that takes pedestrian intent and robot's impact on pedestrian intent into consideration, in addition to the environmental configuration. We outperform current state-of-art algorithms for intent prediction from 3D gaits.

Accepted at ICRA 2023

References in corpus (8)

• Adam: A Method for Stochastic Optimization
• Language Models are Few-Shot Learners
• QuaterNet: A Quaternion-based Recurrent Model for Human Motion
• Identifying Emotions from Walking using Affective and Deep Features
• CrowdMove: Autonomous Mapless Navigation in Crowded Scenarios
• Embodied Visual Recognition
• The Liar's Walk: Detecting Deception with Gait and Gesture
• Adaptable Human Intention and Trajectory Prediction for Human-Robot Collaboration