An End-to-End Network for Co-Saliency Detection in One Single Image
arXiv:1910.11819 · doi:10.1007/s11432-022-3686-1
Abstract
Co-saliency detection within a single image is a common vision problem that has received little attention and has not yet been well addressed. Existing methods often used a bottom-up strategy to infer co-saliency in an image in which salient regions are firstly detected using visual primitives such as color and shape and then grouped and merged into a co-saliency map. However, co-saliency is intrinsically perceived complexly with bottom-up and top-down strategies combined in human vision. To address this problem, this study proposes a novel end-to-end trainable network comprising a backbone net and two branch nets. The backbone net uses ground-truth masks as top-down guidance for saliency prediction, whereas the two branch nets construct triplet proposals for regional feature mapping and clustering, which drives the network to be bottom-up sensitive to co-salient regions. We construct a new dataset of 2,019 natural images with co-saliency in each image to evaluate the proposed method. Experimental results show that the proposed method achieves state-of-the-art accuracy with a running speed of 28 fps.
References in corpus (9)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- TextBoxes++: A Single-Shot Oriented Scene Text Detector
- Review of Visual Saliency Detection with Comprehensive Information
- Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images
- Nested Network with Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images
- DPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detection
- Enhanced-alignment Measure for Binary Foreground Map Evaluation
- Group-wise Deep Co-saliency Detection
- An Iterative Co-Saliency Framework for RGBD Images