Building Footprint Generation by IntegratingConvolution Neural Network with Feature PairwiseConditional Random Field (FPCRF)

Abstract

Building footprint maps are vital to many remote sensing applications, such as 3D building modeling, urban planning, and disaster management. Due to the complexity of buildings, the accurate and reliable generation of the building footprint from remote sensing imagery is still a challenging task. In this work, an end-to-end building footprint generation approach that integrates convolution neural network (CNN) and graph model is proposed. CNN serves as the feature extractor, while the graph model can take spatial correlation into consideration. Moreover, we propose to implement the feature pairwise conditional random field (FPCRF) as a graph model to preserve sharp boundaries and fine-grained segmentation. Experiments are conducted on four different datasets: (1) Planetscope satellite imagery of the cities of Munich, Paris, Rome, and Zurich; (2) ISPRS benchmark data from the city of Potsdam, (3) Dstl Kaggle dataset; and (4) Inria Aerial Image Labeling data of Austin, Chicago, Kitsap County, Western Tyrol, and Vienna. It is found that the proposed end-to-end building footprint generation framework with the FPCRF as the graph model can further improve the accuracy of building footprint generation by using only CNN, which is the current state-of-the-art.

References in corpus (9)

• Deep learning in remote sensing: a review
• Conditional Random Fields as Recurrent Neural Networks
• A Review on Deep Learning Techniques Applied to Semantic Segmentation
• Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery
• Land cover mapping at very high resolution with rotation equivariant CNNs: towards small yet accurate models
• Learning Aerial Image Segmentation from Online Maps
• Deep multi-task learning for a geographically-regularized semantic segmentation of aerial images
• Correcting rural building annotations in OpenStreetMap using convolutional neural networks
• Building Footprint Generation Using Improved Generative Adversarial Networks

Cited by in corpus (5)

• HED-UNet: Combined Segmentation and Edge Detection for Monitoring the Antarctic Coastline
• Building Extraction from Remote Sensing Images via an Uncertainty-Aware Network
• Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images
• Semi-Supervised Building Footprint Generation with Feature and Output Consistency Training
• MultiScene: A Large-scale Dataset and Benchmark for Multi-scene Recognition in Single Aerial Images