AsynEIO: Asynchronous Monocular Event-Inertial Odometry Using Gaussian Process Regression

Abstract

Event cameras, when combined with inertial sensors, show significant potential for motion estimation in challenging scenarios, such as high-speed maneuvers and low-light environments. There are many methods for producing such estimations, but most boil down to a synchronous discrete-time fusion problem. However, the asynchronous nature of event cameras and their unique fusion mechanism with inertial sensors remain underexplored. In this paper, we introduce a monocular event-inertial odometry method called AsynEIO, designed to fuse asynchronous event and inertial data within a unified Gaussian Process (GP) regression framework. Our approach incorporates an event-driven frontend that tracks feature trajectories directly from raw event streams at a high temporal resolution. These tracked feature trajectories, along with various inertial factors, are integrated into the same GP regression framework to enable asynchronous fusion. With deriving analytical residual Jacobians and noise models, our method constructs a factor graph that is iteratively optimized and pruned using a sliding-window optimizer. Comparative assessments highlight the performance of different inertial fusion strategies, suggesting optimal choices for varying conditions. Experimental results on both public datasets and our own event-inertial sequences indicate that AsynEIO outperforms existing methods, especially in high-speed and low-illumination scenarios.

20 pages, 20 figures

References in corpus (11)

• VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator
• Event-based Vision: A Survey
• The Event-Camera Dataset and Simulator: Event-based Data for Pose Estimation, Visual Odometry, and SLAM
• Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarios
• Continuous-Time Visual-Inertial Odometry for Event Cameras
• VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAM
• ESVIO: Event-based Stereo Visual Inertial Odometry
• IDOL: A Framework for IMU-DVS Odometry using Lines
• E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Cameras
• Event-based Stereo Visual Odometry with Native Temporal Resolution via Continuous-time Gaussian Process Regression
• Asynchronous Event-Inertial Odometry using a Unified Gaussian Process Regression Framework