Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera

Abstract

Deploying autonomous robots in crowded indoor environments usually requires them to have accurate dynamic obstacle perception. Although plenty of previous works in the autonomous driving field have investigated the 3D object detection problem, the usage of dense point clouds from a heavy Light Detection and Ranging (LiDAR) sensor and their high computation cost for learning-based data processing make those methods not applicable to small robots, such as vision-based UAVs with small onboard computers. To address this issue, we propose a lightweight 3D dynamic obstacle detection and tracking (DODT) method based on an RGB-D camera, which is designed for low-power robots with limited computing power. Our method adopts a novel ensemble detection strategy, combining multiple computationally efficient but low-accuracy detectors to achieve real-time high-accuracy obstacle detection. Besides, we introduce a new feature-based data association and tracking method to prevent mismatches utilizing point clouds' statistical features. In addition, our system includes an optional and auxiliary learning-based module to enhance the obstacle detection range and dynamic obstacle identification. The proposed method is implemented in a small quadcopter, and the results show that our method can achieve the lowest position error (0.11m) and a comparable velocity error (0.23m/s) across the benchmarking algorithms running on the robot's onboard computer. The flight experiments prove that the tracking results from the proposed method can make the robot efficiently alter its trajectory for navigating dynamic environments. Our software is available on GitHub as an open-source ROS package.

arXiv comment8 pages, 10 figures, 2 tables

References in corpus (7)

• DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments
• The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception
• Large-scale Autonomous Flight with Real-time Semantic SLAM under Dense Forest Canopy
• AirDOS: Dynamic SLAM benefits from Articulated Objects
• PointPWC-Net: A Coarse-to-Fine Network for Supervised and Self-Supervised Scene Flow Estimation on 3D Point Clouds
• Vision-aided UAV navigation and dynamic obstacle avoidance using gradient-based B-spline trajectory optimization
• A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Cited by in corpus (4)

• Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Tracking
• Autonomous Navigation in Dynamic Human Environments with an Embedded 2D LiDAR-based Person Tracker
• Saranga: MilliWatt Ultrasound for Navigation in Visually Degraded Environments on Palm-Sized Aerial Robots
• Engineering an Efficient Object Tracker for Non-Linear Motion