ESFNet: Efficient Network for Building Extraction from High-Resolution Aerial Images

Abstract

Building footprint extraction from high-resolution aerial images is always an essential part of urban dynamic monitoring, planning and management. It has also been a challenging task in remote sensing research. In recent years, deep neural networks have made great achievement in improving accuracy of building extraction from remote sensing imagery. However, most of existing approaches usually require large amount of parameters and floating point operations for high accuracy, it leads to high memory consumption and low inference speed which are harmful to research. In this paper, we proposed a novel efficient network named ESFNet which employs separable factorized residual block and utilizes the dilated convolutions, aiming to preserve slight accuracy loss with low computational cost and memory consumption. Our ESFNet obtains a better trade-off between accuracy and efficiency, it can run at over 100 FPS on single Tesla V100, requires 6x fewer FLOPs and has 18x fewer parameters than state-of-the-art real-time architecture ERFNet while preserving similar accuracy without any additional context module, post-processing and pre-trained scheme. We evaluated our networks on WHU Building Dataset and compared it with other state-of-the-art architectures. The result and comprehensive analysis show that our networks are benefit for efficient remote sensing researches, and the idea can be further extended to other areas. The code is public available at: https://github.com/mrluin/ESFNet-Pytorch

10 pages, 3 figures, 4 tables. Accepted for IEEE Access

References in corpus (17)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Rethinking Atrous Convolution for Semantic Image Segmentation
• Densely Connected Convolutional Networks
• Wide Residual Networks
• ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
• Learning Deconvolution Network for Semantic Segmentation
• Residual Networks Behave Like Ensembles of Relatively Shallow Networks
• Xception: Deep Learning with Depthwise Separable Convolutions
• Pyramid Scene Parsing Network
• ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
• ICNet for Real-Time Semantic Segmentation on High-Resolution Images
• Interleaved Group Convolutions for Deep Neural Networks
• The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation
• ExFuse: Enhancing Feature Fusion for Semantic Segmentation
• DecomposeMe: Simplifying ConvNets for End-to-End Learning
• Effective Use of Dilated Convolutions for Segmenting Small Object Instances in Remote Sensing Imagery