AI Powered Road Network Prediction with Multi-Modal Data

Abstract

This study presents an innovative approach for automatic road detection with deep learning, by employing fusion strategies for utilizing both lower-resolution satellite imagery and GPS trajectory data, a concept never explored before. We rigorously investigate both early and late fusion strategies, and assess deep learning based road detection performance using different fusion settings. Our extensive ablation studies assess the efficacy of our framework under diverse model architectures, loss functions, and geographic domains (Istanbul and Montreal). For an unbiased and complete evaluation of road detection results, we use both region-based and boundary-based evaluation metrics for road segmentation. The outcomes reveal that the ResUnet model outperforms U-Net and D-Linknet in road extraction tasks, achieving superior results over the benchmark study using low-resolution Sentinel-2 data. This research not only contributes to the field of automatic road detection but also offers novel insights into the utilization of data fusion methods in diverse applications.

References in corpus (8)

• Road Extraction by Deep Residual U-Net
• DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images
• A survey of loss functions for semantic segmentation
• Metrics reloaded: Recommendations for image analysis validation
• City-Scale Road Extraction from Satellite Imagery v2: Road Speeds and Travel Times
• Measures of Complexity for Large Scale Image Datasets
• Road Network and Travel Time Extraction from Multiple Look Angles with SpaceNet Data
• Performance Evaluation of GPS Trajectory Rasterization Methods