A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation
arXiv:1804.01306 · doi:10.1109/CVPR.2018.00407
Abstract
We present a unifying framework to solve several computer vision problems with event cameras: motion, depth and optical flow estimation. The main idea of our framework is to find the point trajectories on the image plane that are best aligned with the event data by maximizing an objective function: the contrast of an image of warped events. Our method implicitly handles data association between the events, and therefore, does not rely on additional appearance information about the scene. In addition to accurately recovering the motion parameters of the problem, our framework produces motion-corrected edge-like images with high dynamic range that can be used for further scene analysis. The proposed method is not only simple, but more importantly, it is, to the best of our knowledge, the first method that can be successfully applied to such a diverse set of important vision tasks with event cameras.
arXiv comment16 pages, 16 figures. Video: https://youtu.be/KFMZFhi-9Aw
References in corpus (3)
Cited by in corpus (44)
- Event-based Vision: A Survey
- Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars
- Event-based Moving Object Detection and Tracking
- Event-based Stereo Visual Odometry
- Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perception
- Continuous-Time Visual-Inertial Odometry for Event Cameras
- Asynchronous, Photometric Feature Tracking using Events and Frames
- Focus Is All You Need: Loss Functions For Event-based Vision
- Semi-Dense 3D Reconstruction with a Stereo Event Camera
- Event-aided Direct Sparse Odometry
- Secrets of Event-Based Optical Flow
- Event-based Motion Segmentation with Spatio-Temporal Graph Cuts
- Learning Dense and Continuous Optical Flow from an Event Camera
- Event-based visual place recognition with ensembles of temporal windows
- Asynchronous Tracking-by-Detection on Adaptive Time Surfaces for Event-based Object Tracking
- E-MLB: Multilevel Benchmark for Event-Based Camera Denoising
- CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximization
- Globally-Optimal Contrast Maximisation for Event Cameras
- Event-based Background-Oriented Schlieren
- The Spatio-Temporal Poisson Point Process: A Simple Model for the Alignment of Event Camera Data
- Event Collapse in Contrast Maximization Frameworks
- Formulating Event-based Image Reconstruction as a Linear Inverse Problem with Deep Regularization using Optical Flow
- ESVO2: Direct Visual-Inertial Odometry with Stereo Event Cameras
- Neuromorphic Perception and Navigation for Mobile Robots: A Review
- Globally-Optimal Event Camera Motion Estimation
- Stereo Hybrid Event-Frame (SHEF) Cameras for 3D Perception
- Lightweight Event-based Optical Flow Estimation via Iterative Deblurring
- Photorealistic Image Reconstruction from Hybrid Intensity and Event based Sensor
- Fast Event-based Optical Flow Estimation by Triplet Matching
- Event-based Stereo Depth Estimation: A Survey
- Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation
- A 5-Point Minimal Solver for Event Camera Relative Motion Estimation
- Dense Voxel 3D Reconstruction Using a Monocular Event Camera
- A wireless signal-based sensing framework for robotics
- Visual Odometry with Neuromorphic Resonator Networks
- An N-Point Linear Solver for Line and Motion Estimation with Event Cameras
- ES-PTAM: Event-based Stereo Parallel Tracking and Mapping
- A Fast and Accurate Optical Flow Camera for Resource-Constrained Edge Applications
- On the Benefits of Visual Stabilization for Frame- and Event-based Perception
- Event-based Photometric Bundle Adjustment
- VibES: Induced Vibration for Persistent Event-Based Sensing
- Low-Latency Event-Based Velocimetry for Quadrotor Control in a Narrow Pipe
- Event-based Mosaicing Bundle Adjustment
- FPGA-Based Hardware Architecture for Contrast Maximization in Event-Based Vision