Learning Aerial Image Segmentation from Online Maps

Abstract

This study deals with semantic segmentation of high-resolution (aerial) images where a semantic class label is assigned to each pixel via supervised classification as a basis for automatic map generation. Recently, deep convolutional neural networks (CNNs) have shown impressive performance and have quickly become the de-facto standard for semantic segmentation, with the added benefit that task-specific feature design is no longer necessary. However, a major downside of deep learning methods is that they are extremely data-hungry, thus aggravating the perennial bottleneck of supervised classification, to obtain enough annotated training data. On the other hand, it has been observed that they are rather robust against noise in the training labels. This opens up the intriguing possibility to avoid annotating huge amounts of training data, and instead train the classifier from existing legacy data or crowd-sourced maps which can exhibit high levels of noise. The question addressed in this paper is: can training with large-scale, publicly available labels replace a substantial part of the manual labeling effort and still achieve sufficient performance? Such data will inevitably contain a significant portion of errors, but in return virtually unlimited quantities of it are available in larger parts of the world. We adapt a state-of-the-art CNN architecture for semantic segmentation of buildings and roads in aerial images, and compare its performance when using different training data sets, ranging from manually labeled, pixel-accurate ground truth of the same city to automatic training data derived from OpenStreetMap data from distant locations. We report our results that indicate that satisfying performance can be obtained with significantly less manual annotation effort, by exploiting noisy large-scale training data.

Published in IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING

Cited by in corpus (15)

• Improving Semantic Segmentation of Aerial Images Using Patch-based Attention
• OpenStreetMap: Challenges and Opportunities in Machine Learning and Remote Sensing
• Aerial Imagery for Roof Segmentation: A Large-Scale Dataset towards Automatic Mapping of Buildings
• Building Footprint Generation by IntegratingConvolution Neural Network with Feature PairwiseConditional Random Field (FPCRF)
• Correcting rural building annotations in OpenStreetMap using convolutional neural networks
• Precipitation Nowcasting with Satellite Imagery
• An Entropic Optimal Transport Loss for Learning Deep Neural Networks under Label Noise in Remote Sensing Images
• Mapping oil palm density at country scale: An active learning approach
• High-throughput Onboard Hyperspectral Image Compression with Ground-based CNN Reconstruction
• Hidden Path Selection Network for Semantic Segmentation of Remote Sensing Images
• A large-scale climate-aware satellite image dataset for domain adaptive land-cover semantic segmentation
• Deploying machine learning to assist digital humanitarians: making image annotation in OpenStreetMap more efficient
• LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Images
• Semantic Labeling of Large-Area Geographic Regions Using Multi-View and Multi-Date Satellite Images and Noisy OSM Training Labels
• On the Adversarial Vulnerabilities of Transfer Learning in Remote Sensing