Road surface 3d reconstruction based on dense subpixel disparity map estimation

Abstract

Various 3D reconstruction methods have enabled civil engineers to detect damage on a road surface. To achieve the millimetre accuracy required for road condition assessment, a disparity map with subpixel resolution needs to be used. However, none of the existing stereo matching algorithms are specially suitable for the reconstruction of the road surface. Hence in this paper, we propose a novel dense subpixel disparity estimation algorithm with high computational efficiency and robustness. This is achieved by first transforming the perspective view of the target frame into the reference view, which not only increases the accuracy of the block matching for the road surface but also improves the processing speed. The disparities are then estimated iteratively using our previously published algorithm where the search range is propagated from three estimated neighbouring disparities. Since the search range is obtained from the previous iteration, errors may occur when the propagated search range is not sufficient. Therefore, a correlation maxima verification is performed to rectify this issue, and the subpixel resolution is achieved by conducting a parabola interpolation enhancement. Furthermore, a novel disparity global refinement approach developed from the Markov Random Fields and Fast Bilateral Stereo is introduced to further improve the accuracy of the estimated disparity map, where disparities are updated iteratively by minimising the energy function that is related to their interpolated correlation polynomials. The algorithm is implemented in C language with a near real-time performance. The experimental results illustrate that the absolute error of the reconstruction varies from 0.1 mm to 3 mm.

11 pages, 16 figures, IEEE Transactions on Image Processing

Cited by in corpus (33)

• Pothole Detection Based on Disparity Transformation and Road Surface Modeling
• Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithms
• Road Damage Detection Based on Unsupervised Disparity Map Segmentation
• Graph Attention Layer Evolves Semantic Segmentation for Road Pothole Detection: A Benchmark and Algorithms
• PVStereo: Pyramid Voting Module for End-to-End Self-Supervised Stereo Matching
• Learning Collision-Free Space Detection from Stereo Images: Homography Matrix Brings Better Data Augmentation
• RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsing
• Multi-Scale Feature Fusion: Learning Better Semantic Segmentation for Road Pothole Detection
• Applying Surface Normal Information in Drivable Area and Road Anomaly Detection for Ground Mobile Robots
• Real-time stereo vision-based lane detection system
• We Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain Adaptation
• S${}^3$M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Driving
• Key Ingredients of Self-Driving Cars
• Computer Stereo Vision for Autonomous Driving
• Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding
• Freespace Optical Flow Modeling for Automated Driving
• Real-Time Subpixel Fast Bilateral Stereo
• Rethinking Road Surface 3D Reconstruction and Pothole Detection: From Perspective Transformation to Disparity Map Segmentation
• Real-Time Dense Stereo Embedded in A UAV for Road Inspection
• Real-Time Stereo Vision for Road Surface 3-D Reconstruction
• Multiple Lane Detection Algorithm Based on Optimised Dense Disparity Map Estimation
• PT-ResNet: Perspective Transformation-Based Residual Network for Semantic Road Image Segmentation
• Low-Cost GPS-Aided LiDAR State Estimation and Map Building
• A Robust Pavement Mapping System Based on Normal-Constrained Stereo Visual Odometry
• Autonomous UAV Landing System Based on Visual Navigation
• Establishing Reality-Virtuality Interconnections in Urban Digital Twins for Superior Intelligent Road Inspection and Simulation
• Robust Lane Marking Detection Algorithm Using Drivable Area Segmentation and Extended SLT
• SCV-Stereo: Learning Stereo Matching from a Sparse Cost Volume
• Road Curb Detection Using A Novel Tensor Voting Algorithm
• Co-Teaching: An Ark to Unsupervised Stereo Matching
• A Robust Roll Angle Estimation Algorithm Based on Gradient Descent
• Mobile Robot Localisation and Navigation Using LEGO NXT and Ultrasonic Sensor
• A Novel Disparity Transformation Algorithm for Road Segmentation