RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments
arXiv:2310.15072 · doi:10.1109/TVCG.2024.3353263
Abstract
It is typically challenging for visual or visual-inertial odometry systems to handle the problems of dynamic scenes and pure rotation. In this work, we design a novel visual-inertial odometry (VIO) system called RD-VIO to handle both of these two problems. Firstly, we propose an IMU-PARSAC algorithm which can robustly detect and match keypoints in a two-stage process. In the first state, landmarks are matched with new keypoints using visual and IMU measurements. We collect statistical information from the matching and then guide the intra-keypoint matching in the second stage. Secondly, to handle the problem of pure rotation, we detect the motion type and adapt the deferred-triangulation technique during the data-association process. We make the pure-rotational frames into the special subframes. When solving the visual-inertial bundle adjustment, they provide additional constraints to the pure-rotational motion. We evaluate the proposed VIO system on public datasets and online comparison. Experiments show the proposed RD-VIO has obvious advantages over other methods in dynamic environments. The source code is available at: \href{https://github.com/openxrlab/xrslam}{{\fontfamily{pcr}\selectfont https://github.com/openxrlab/xrslam}}.
References in corpus (14)
- ORB-SLAM: a Versatile and Accurate Monocular SLAM System
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
- ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM
- On-Manifold Preintegration for Real-Time Visual-Inertial Odometry
- DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenes
- DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments
- Visual-Inertial Monocular SLAM with Map Reuse
- A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensors
- Vox-Fusion: Dense Tracking and Mapping with Voxel-based Neural Implicit Representation
- Direct Sparse Visual-Inertial Odometry using Dynamic Marginalization
- A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors
- DM-VIO: Delayed Marginalization Visual-Inertial Odometry
- RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environments
- PL-VINS: Real-Time Monocular Visual-Inertial SLAM with Point and Line Features