CalibDNN: Multimodal Sensor Calibration for Perception Using Deep Neural Networks
arXiv:2103.14793
Abstract
Current perception systems often carry multimodal imagers and sensors such as 2D cameras and 3D LiDAR sensors. To fuse and utilize the data for downstream perception tasks, robust and accurate calibration of the multimodal sensor data is essential. We propose a novel deep learning-driven technique (CalibDNN) for accurate calibration among multimodal sensor, specifically LiDAR-Camera pairs. The key innovation of the proposed work is that it does not require any specific calibration targets or hardware assistants, and the entire processing is fully automatic with a single model and single iteration. Results comparison among different methods and extensive experiments on different datasets demonstrates the state-of-the-art performance.
References in corpus (5)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
- CalibNet: Geometrically Supervised Extrinsic Calibration using 3D Spatial Transformer Networks
- SOIC: Semantic Online Initialization and Calibration for LiDAR and Camera
- RELLIS-3D Dataset: Data, Benchmarks and Analysis