RGBD Salient Object Detection via Deep Fusion

Abstract

Numerous efforts have been made to design different low level saliency cues for the RGBD saliency detection, such as color or depth contrast features, background and color compactness priors. However, how these saliency cues interact with each other and how to incorporate these low level saliency cues effectively to generate a master saliency map remain a challenging problem. In this paper, we design a new convolutional neural network (CNN) to fuse different low level saliency cues into hierarchical features for automatically detecting salient objects in RGBD images. In contrast to the existing works that directly feed raw image pixels to the CNN, the proposed method takes advantage of the knowledge in traditional saliency detection by adopting various meaningful and well-designed saliency feature vectors as input. This can guide the training of CNN towards detecting salient object more effectively due to the reduced learning ambiguity. We then integrate a Laplacian propagation framework with the learned CNN to extract a spatially consistent saliency map by exploiting the intrinsic structure of the input image. Extensive quantitative and qualitative experimental evaluations on three datasets demonstrate that the proposed method consistently outperforms state-of-the-art methods.

This paper has been submitted to IEEE Transactions on Image Processing

References in corpus (1)

• DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection

Cited by in corpus (18)

• Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
• Vision-based Robotic Grasping From Object Localization, Object Pose Estimation to Grasp Estimation for Parallel Grippers: A Review
• Review of Visual Saliency Detection with Comprehensive Information
• RGB-D Salient Object Detection: A Survey
• Multi-interactive Dual-decoder for RGB-thermal Salient Object Detection
• DPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detection
• CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detection
• CIR-Net: Cross-modality Interaction and Refinement for RGB-D Salient Object Detection
• Bilateral Attention Network for RGB-D Salient Object Detection
• Bifurcated backbone strategy for RGB-D salient object detection
• Indoor Scene Understanding in 2.5/3D for Autonomous Agents: A Survey
• Depth Quality Aware Salient Object Detection
• Data-Level Recombination and Lightweight Fusion Scheme for RGB-D Salient Object Detection
• Middle-level Fusion for Lightweight RGB-D Salient Object Detection
• RGB-D Salient Object Detection with Ubiquitous Target Awareness
• YoTube: Searching Action Proposal via Recurrent and Static Regression Networks
• Boosting RGB-D Saliency Detection by Leveraging Unlabeled RGB Images
• Multi-Scale Iterative Refinement Network for RGB-D Salient Object Detection