Learning Sparse Interaction Graphs of Partially Detected Pedestrians for Trajectory Prediction

Abstract

Multi-pedestrian trajectory prediction is an indispensable element of autonomous systems that safely interact with crowds in unstructured environments. Many recent efforts in trajectory prediction algorithms have focused on understanding social norms behind pedestrian motions. Yet we observe these works usually hold two assumptions, which prevent them from being smoothly applied to robot applications: (1) positions of all pedestrians are consistently tracked, and (2) the target agent pays attention to all pedestrians in the scene. The first assumption leads to biased interaction modeling with incomplete pedestrian data. The second assumption introduces aggregation of redundant surrounding information, and the target agent may be affected by unimportant neighbors or present overly conservative motion. Thus, we propose Gumbel Social Transformer, in which an Edge Gumbel Selector samples a sparse interaction graph of partially detected pedestrians at each time step. A Node Transformer Encoder and a Masked LSTM encode pedestrian features with sampled sparse graphs to predict trajectories. We demonstrate that our model overcomes potential problems caused by the aforementioned assumptions, and our approach outperforms related works in trajectory prediction benchmarks. Code is available at \url{https://github.com/tedhuang96/gst}.

arXiv comment8 pages, 6 figures, Accepted by RA-L with ICRA 2022 presentation option

References in corpus (12)

• Adam: A Method for Stochastic Optimization
• Social Force Model for Pedestrian Dynamics
• Categorical Reparameterization with Gumbel-Softmax
• The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables
• Junction Tree Variational Autoencoder for Molecular Graph Generation
• Human Motion Trajectory Prediction: A Survey
• DropEdge: Towards Deep Graph Convolutional Networks on Node Classification
• GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models
• Neural Relational Inference for Interacting Systems
• Learning Discrete Structures for Graph Neural Networks
• Causal Discovery with Reinforcement Learning
• Long-term Pedestrian Trajectory Prediction using Mutable Intention Filter and Warp LSTM

Cited by in corpus (1)

• A Spatio-temporal Graph Network Allowing Incomplete Trajectory Input for Pedestrian Trajectory Prediction