LiDAR-Camera Calibration using 3D-3D Point correspondences
arXiv:1705.09785
Abstract
With the advent of autonomous vehicles, LiDAR and cameras have become an indispensable combination of sensors. They both provide rich and complementary data which can be used by various algorithms and machine learning to sense and make vital inferences about the surroundings. We propose a novel pipeline and experimental setup to find accurate rigid-body transformation for extrinsically calibrating a LiDAR and a camera. The pipeling uses 3D-3D point correspondences in LiDAR and camera frame and gives a closed form solution. We further show the accuracy of the estimate by fusing point clouds from two stereo cameras which align perfectly with the rotation and translation estimated by our method, confirming the accuracy of our method's estimates both mathematically and visually. Taking our idea of extrinsic LiDAR-camera calibration forward, we demonstrate how two cameras with no overlapping field-of-view can also be calibrated extrinsically using 3D point correspondences. The code has been made available as open-source software in the form of a ROS package, more information about which can be sought here: https://github.com/ankitdhall/lidar_camera_calibration .
Cited by in corpus (12)
- CalibNet: Geometrically Supervised Extrinsic Calibration using 3D Spatial Transformer Networks
- Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups
- Improvements to Target-Based 3D LiDAR to Camera Calibration
- A Survey of Simultaneous Localization and Mapping with an Envision in 6G Wireless Networks
- Bridging the Gap between Open Source Software and Vehicle Hardware for Autonomous Driving
- DurLAR: A High-fidelity 128-channel LiDAR Dataset with Panoramic Ambient and Reflectivity Imagery for Multi-modal Autonomous Driving Applications
- Automatic Target-Less Camera-LiDAR Calibration From Motion and Deep Point Correspondences
- Detection and depth estimation for domestic waste in outdoor environments by sensors fusion
- Detection of Binary Square Fiducial Markers Using an Event Camera
- Line-based Camera Pose Estimation in Point Cloud of Structured Environments
- ViKi-HyCo: A Hybrid-Control approach for complex car-like maneuvers
- Advanced Mapping Robot and High-Resolution Dataset