Pothole Detection Based on Disparity Transformation and Road Surface Modeling

Abstract

Pothole detection is one of the most important tasks for road maintenance. Computer vision approaches are generally based on either 2D road image analysis or 3D road surface modeling. However, these two categories are always used independently. Furthermore, the pothole detection accuracy is still far from satisfactory. Therefore, in this paper, we present a robust pothole detection algorithm that is both accurate and computationally efficient. A dense disparity map is first transformed to better distinguish between damaged and undamaged road areas. To achieve greater disparity transformation efficiency, golden section search and dynamic programming are utilized to estimate the transformation parameters. Otsu's thresholding method is then used to extract potential undamaged road areas from the transformed disparity map. The disparities in the extracted areas are modeled by a quadratic surface using least squares fitting. To improve disparity map modeling robustness, the surface normal is also integrated into the surface modeling process. Furthermore, random sample consensus is utilized to reduce the effects caused by outliers. By comparing the difference between the actual and modeled disparity maps, the potholes can be detected accurately. Finally, the point clouds of the detected potholes are extracted from the reconstructed 3D road surface. The experimental results show that the successful detection accuracy of the proposed system is around 98.7% and the overall pixel-level accuracy is approximately 99.6%.

12 pages, 15 figures, IEEE Transactions on Image Processing

Cited by in corpus (15)

• SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detection
• Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithms
• Road Damage Detection Based on Unsupervised Disparity Map Segmentation
• Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithms
• Graph Attention Layer Evolves Semantic Segmentation for Road Pothole Detection: A Benchmark and Algorithms
• Learning Collision-Free Space Detection from Stereo Images: Homography Matrix Brings Better Data Augmentation
• RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsing
• Multi-Scale Feature Fusion: Learning Better Semantic Segmentation for Road Pothole Detection
• Applying Surface Normal Information in Drivable Area and Road Anomaly Detection for Ground Mobile Robots
• We Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain Adaptation
• Three-Filters-to-Normal: An Accurate and Ultrafast Surface Normal Estimator
• Freespace Optical Flow Modeling for Automated Driving
• 3D-DEEP: 3-Dimensional Deep-learning based on elevation patterns forroad scene interpretation
• PotholeGuard: A Pothole Detection Approach by Point Cloud Semantic Segmentation
• Establishing Reality-Virtuality Interconnections in Urban Digital Twins for Superior Intelligent Road Inspection and Simulation