An N-Point Linear Solver for Line and Motion Estimation with Event Cameras

Abstract

Event cameras respond primarily to edges--formed by strong gradients--and are thus particularly well-suited for line-based motion estimation. Recent work has shown that events generated by a single line each satisfy a polynomial constraint which describes a manifold in the space-time volume. Multiple such constraints can be solved simultaneously to recover the partial linear velocity and line parameters. In this work, we show that, with a suitable line parametrization, this system of constraints is actually linear in the unknowns, which allows us to design a novel linear solver. Unlike existing solvers, our linear solver (i) is fast and numerically stable since it does not rely on expensive root finding, (ii) can solve both minimal and overdetermined systems with more than 5 events, and (iii) admits the characterization of all degenerate cases and multiple solutions. The found line parameters are singularity-free and have a fixed scale, which eliminates the need for auxiliary constraints typically encountered in previous work. To recover the full linear camera velocity we fuse observations from multiple lines with a novel velocity averaging scheme that relies on a geometrically-motivated residual, and thus solves the problem more efficiently than previous schemes which minimize an algebraic residual. Extensive experiments in synthetic and real-world settings demonstrate that our method surpasses the previous work in numerical stability, and operates over 600 times faster.

References in corpus (13)

• Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
• Event-based Vision: A Survey
• Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars
• Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarios
• A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation
• Event-based, 6-DOF Camera Tracking from Photometric Depth Maps
• Continuous-Time Visual-Inertial Odometry for Event Cameras
• Event-aided Direct Sparse Odometry
• VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAM
• Globally-Optimal Contrast Maximisation for Event Cameras
• IDOL: A Framework for IMU-DVS Odometry using Lines
• A 5-Point Minimal Solver for Event Camera Relative Motion Estimation
• Continuous Event-Line Constraint for Closed-Form Velocity Initialization

Cited by in corpus (1)

• Motion-Aware Optical Camera Communication with Event Cameras