Prediction of Human Trajectory Following a Haptic Robotic Guide Using Recurrent Neural Networks

Abstract

Social intelligence is an important requirement for enabling robots to collaborate with people. In particular, human path prediction is an essential capability for robots in that it prevents potential collision with a human and allows the robot to safely make larger movements. In this paper, we present a method for predicting the trajectory of a human who follows a haptic robotic guide without using sight, which is valuable for assistive robots that aid the visually impaired. We apply a deep learning method based on recurrent neural networks using multimodal data: (1) human trajectory, (2) movement of the robotic guide, (3) haptic input data measured from the physical interaction between the human and the robot, (4) human depth data. We collected actual human trajectory and multimodal response data through indoor experiments. Our model outperformed the baseline result while using only the robot data with the observed human trajectory, and it shows even better results when using additional haptic and depth data.

arXiv comment6 pages, Submitted to IEEE World Haptics Conference 2019

References in corpus (1)

• Social Force Model for Pedestrian Dynamics

Cited by in corpus (9)

• Effects of Initial Attitude Estimation Errors on Loosely Coupled Smartphone GPS/IMU Integration System
• Fast User Adaptation for Human Motion Prediction in Physical Human-Robot Interaction
• Motion Planning by Reinforcement Learning for an Unmanned Aerial Vehicle in Virtual Open Space with Static Obstacles
• Machine Learning-Based GPS Multipath Detection Method Using Dual Antennas
• Dynamic Difficulty Adjustment via Fast User Adaptation
• Optimal Action-based or User Prediction-based Haptic Guidance: Can You Do Even Better?
• Predicting human motion intention for pHRI assistive control
• Sample-Efficient Training of Robotic Guide Using Human Path Prediction Network
• Movement Detection of Tongue and Related Body Parts Using IR-UWB Radar