BAMF-SLAM: Bundle Adjusted Multi-Fisheye Visual-Inertial SLAM Using Recurrent Field Transforms
arXiv:2306.01173 · doi:10.1109/ICRA48891.2023.10160905
Abstract
In this paper, we present BAMF-SLAM, a novel multi-fisheye visual-inertial SLAM system that utilizes Bundle Adjustment (BA) and recurrent field transforms (RFT) to achieve accurate and robust state estimation in challenging scenarios. First, our system directly operates on raw fisheye images, enabling us to fully exploit the wide Field-of-View (FoV) of fisheye cameras. Second, to overcome the low-texture challenge, we explore the tightly-coupled integration of multi-camera inputs and complementary inertial measurements via a unified factor graph and jointly optimize the poses and dense depth maps. Third, for global consistency, the wide FoV of the fisheye camera allows the system to find more potential loop closures, and powered by the broad convergence basin of RFT, our system can perform very wide baseline loop closing with little overlap. Furthermore, we introduce a semi-pose-graph BA method to avoid the expensive full global BA. By combining relative pose factors with loop closure factors, the global states can be adjusted efficiently with modest memory footprint while maintaining high accuracy. Evaluations on TUM-VI, Hilti-Oxford and Newer College datasets show the superior performance of the proposed system over prior works. In the Hilti SLAM Challenge 2022, our VIO version achieves second place. In a subsequent submission, our complete system, including the global BA backend, outperforms the winning approach.
arXiv commentAccepted to ICRA2023
References in corpus (12)
- ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras
- VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
- ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM
- Visual-Inertial Monocular SLAM with Map Reuse
- The TUM VI Benchmark for Evaluating Visual-Inertial Odometry
- DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Cameras
- Visual-Inertial Mapping with Non-Linear Factor Recovery
- Hilti-Oxford Dataset: A Millimetre-Accurate Benchmark for Simultaneous Localization and Mapping
- Redesigning SLAM for Arbitrary Multi-Camera Systems
- Balancing the Budget: Feature Selection and Tracking for Multi-Camera Visual-Inertial Odometry
- Multi-Camera LiDAR Inertial Extension to the Newer College Dataset
- OKVIS2: Realtime Scalable Visual-Inertial SLAM with Loop Closure