ES-PTAM: Event-based Stereo Parallel Tracking and Mapping
arXiv:2408.15605 · doi:10.1007/978-3-031-92460-6_5
Abstract
Visual Odometry (VO) and SLAM are fundamental components for spatial perception in mobile robots. Despite enormous progress in the field, current VO/SLAM systems are limited by their sensors' capability. Event cameras are novel visual sensors that offer advantages to overcome the limitations of standard cameras, enabling robots to expand their operating range to challenging scenarios, such as high-speed motion and high dynamic range illumination. We propose a novel event-based stereo VO system by combining two ideas: a correspondence-free mapping module that estimates depth by maximizing ray density fusion and a tracking module that estimates camera poses by maximizing edge-map alignment. We evaluate the system comprehensively on five real-world datasets, spanning a variety of camera types (manufacturers and spatial resolutions) and scenarios (driving, flying drone, hand-held, egocentric, etc). The quantitative and qualitative results demonstrate that our method outperforms the state of the art in majority of the test sequences by a margin, e.g., trajectory error reduction of 45% on RPG dataset, 61% on DSEC dataset, and 21% on TUM-VIE dataset. To benefit the community and foster research on event-based perception systems, we release the source code and results: https://github.com/tub-rip/ES-PTAM
17 pages, 7 figures, 4 tables, https://github.com/tub-rip/ES-PTAM
References in corpus (11)
- Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
- Event-based Vision: A Survey
- The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception
- Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarios
- A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation
- Semi-Dense 3D Reconstruction with a Stereo Event Camera
- Event-aided Direct Sparse Odometry
- CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximization
- Multi-Event-Camera Depth Estimation and Outlier Rejection by Refocused Events Fusion
- Event-based Stereo Visual Odometry with Native Temporal Resolution via Continuous-time Gaussian Process Regression
- EVIMO2: An Event Camera Dataset for Motion Segmentation, Optical Flow, Structure from Motion, and Visual Inertial Odometry in Indoor Scenes with Monocular or Stereo Algorithms