An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Abstract

Semantic segmentation is an essential part of deep learning. In recent years, with the development of remote sensing big data, semantic segmentation has been increasingly used in remote sensing. Deep convolutional neural networks (DCNNs) face the challenge of feature fusion: very-high-resolution remote sensing image multisource data fusion can increase the network's learnable information, which is conducive to correctly classifying target objects by DCNNs; simultaneously, the fusion of high-level abstract features and low-level spatial features can improve the classification accuracy at the border between target objects. In this paper, we propose a multipath encoder structure to extract features of multipath inputs, a multipath attention-fused block module to fuse multipath features, and a refinement attention-fused block module to fuse high-level abstract features and low-level spatial features. Furthermore, we propose a novel convolutional neural network architecture, named attention-fused network (AFNet). Based on our AFNet, we achieve state-of-the-art performance with an overall accuracy of 91.7% and a mean F1 score of 90.96% on the ISPRS Vaihingen 2D dataset and an overall accuracy of 92.1% and a mean F1 score of 93.44% on the ISPRS Potsdam 2D dataset.

arXiv comment35 pages. Published by ISPRS Journal of Photogrammetry and Remote Sensing

References in corpus (11)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• SSD: Single Shot MultiBox Detector
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Rethinking Atrous Convolution for Semantic Image Segmentation
• ParseNet: Looking Wider to See Better
• A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community
• Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery using Deep Learning
• Land Use Classification in Remote Sensing Images by Convolutional Neural Networks
• Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network
• Dynamic Multi-Context Segmentation of Remote Sensing Images based on Convolutional Networks

Cited by in corpus (6)

• UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery
• Semantic Labeling of High Resolution Images Using EfficientUNets and Transformers
• A large-scale climate-aware satellite image dataset for domain adaptive land-cover semantic segmentation
• CORE-ReID V2: Advancing the Domain Adaptation for Object Re-Identification with Optimized Training and Ensemble Fusion
• Multi-encoder ConvNeXt Network with Smooth Attentional Feature Fusion for Multispectral Semantic Segmentation
• AASeg: Attention Aware Network for Real Time Semantic Segmentation