Stereo-LiDAR Fusion by Semi-Global Matching With Discrete Disparity-Matching Cost and Semidensification

Abstract

We present a real-time, non-learning depth estimation method that fuses Light Detection and Ranging (LiDAR) data with stereo camera input. Our approach comprises three key techniques: Semi-Global Matching (SGM) stereo with Discrete Disparity-matching Cost (DDC), semidensification of LiDAR disparity, and a consistency check that combines stereo images and LiDAR data. Each of these components is designed for parallelization on a GPU to realize real-time performance. When it was evaluated on the KITTI dataset, the proposed method achieved an error rate of 2.79\%, outperforming the previous state-of-the-art real-time stereo-LiDAR fusion method, which had an error rate of 3.05\%. Furthermore, we tested the proposed method in various scenarios, including different LiDAR point densities, varying weather conditions, and indoor environments, to demonstrate its high adaptability. We believe that the real-time and non-learning nature of our method makes it highly practical for applications in robotics and automation.

8 pages, 8 figures, 7 tables

References in corpus (4)

• Embedded real-time stereo estimation via Semi-Global Matching on the GPU
• PVStereo: Pyramid Voting Module for End-to-End Self-Supervised Stereo Matching
• Discontinuous and Smooth Depth Completion with Binary Anisotropic Diffusion Tensor
• Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matching