Multi-Content Complementation Network for Salient Object Detection in Optical Remote Sensing Images

Abstract

In the computer vision community, great progresses have been achieved in salient object detection from natural scene images (NSI-SOD); by contrast, salient object detection in optical remote sensing images (RSI-SOD) remains to be a challenging emerging topic. The unique characteristics of optical RSIs, such as scales, illuminations and imaging orientations, bring significant differences between NSI-SOD and RSI-SOD. In this paper, we propose a novel Multi-Content Complementation Network (MCCNet) to explore the complementarity of multiple content for RSI-SOD. Specifically, MCCNet is based on the general encoder-decoder architecture, and contains a novel key component named Multi-Content Complementation Module (MCCM), which bridges the encoder and the decoder. In MCCM, we consider multiple types of features that are critical to RSI-SOD, including foreground features, edge features, background features, and global image-level features, and exploit the content complementarity between them to highlight salient regions over various scales in RSI features through the attention mechanism. Besides, we comprehensively introduce pixel-level, map-level and metric-aware losses in the training phase. Extensive experiments on two popular datasets demonstrate that the proposed MCCNet outperforms 23 state-of-the-art methods, including both NSI-SOD and RSI-SOD methods. The code and results of our method are available at https://github.com/MathLee/MCCNet.

arXiv comment12 pages, 7 figures, Accepted by IEEE Transactions on Geoscience and Remote Sensing 2021

References in corpus (13)

• Rethinking Atrous Convolution for Semantic Image Segmentation
• U${}^2$-Net: Going Deeper with Nested U-Structure for Salient Object Detection
• Graph Convolutional Networks for Hyperspectral Image Classification
• More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classification
• Salient Object Detection: A Benchmark
• An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing
• Review of Visual Saliency Detection with Comprehensive Information
• Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
• Nested Network with Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images
• X-ModalNet: A Semi-Supervised Deep Cross-Modal Network for Classification of Remote Sensing Data
• Edge Preserving and Multi-Scale Contextual Neural Network for Salient Object Detection
• A Parallel Down-Up Fusion Network for Salient Object Detection in Optical Remote Sensing Images
• Personal Fixations-Based Object Segmentation with Object Localization and Boundary Preservation

Cited by in corpus (4)

• Lightweight Salient Object Detection in Optical Remote Sensing Images via Feature Correlation
• Lightweight Salient Object Detection in Optical Remote-Sensing Images via Semantic Matching and Edge Alignment
• Salient Object Detection in Optical Remote Sensing Images Driven by Transformer
• Texture-Semantic Collaboration Network for ORSI Salient Object Detection