Salient Object Detection: A Benchmark
arXiv:1501.02741 · doi:10.1109/TIP.2015.2487833
Abstract
We extensively compare, qualitatively and quantitatively, 40 state-of-the-art models (28 salient object detection, 10 fixation prediction, 1 objectness, and 1 baseline) over 6 challenging datasets for the purpose of benchmarking salient object detection and segmentation methods. From the results obtained so far, our evaluation shows a consistent rapid progress over the last few years in terms of both accuracy and running time. The top contenders in this benchmark significantly outperform the models identified as the best in the previous benchmark conducted just two years ago. We find that the models designed specifically for salient object detection generally work better than models in closely related areas, which in turn provides a precise definition and suggests an appropriate treatment of this problem that distinguishes it from other problems. In particular, we analyze the influences of center bias and scene complexity in model performance, which, along with the hard cases for state-of-the-art models, provide useful hints towards constructing more challenging large scale datasets and better saliency models. Finally, we propose probable solutions for tackling several open problems such as evaluation scores and dataset bias, which also suggest future research directions in the rapidly-growing field of salient object detection.
References in corpus (2)
Cited by in corpus (72)
- Res2Net: A New Multi-scale Backbone Architecture
- Concealed Object Detection
- Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks
- Deeply supervised salient object detection with short connections
- Single-chip photonic deep neural network for instantaneous image classification
- Video Salient Object Detection via Fully Convolutional Networks
- STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation
- Deep Visual Attention Prediction
- DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection
- Review of Visual Saliency Detection with Comprehensive Information
- SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection
- RGB-D Salient Object Detection: A Survey
- Nested Network with Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images
- Deep Gradient Learning for Efficient Camouflaged Object Detection
- Bilateral Attention Network for RGB-D Salient Object Detection
- Video Polyp Segmentation: A Deep Learning Perspective
- Bifurcated backbone strategy for RGB-D salient object detection
- HRTransNet: HRFormer-Driven Two-Modality Salient Object Detection
- Re-thinking Co-Salient Object Detection
- Lightweight Salient Object Detection in Optical Remote Sensing Images via Feature Correlation
- CAGNet: Content-Aware Guidance for Salient Object Detection
- Advances in Deep Concealed Scene Understanding
- Edge Preserving and Multi-Scale Contextual Neural Network for Salient Object Detection
- Co-saliency Detection for RGBD Images Based on Multi-constraint Feature Matching and Cross Label Propagation
- Salient Object Detection in Optical Remote Sensing Images Driven by Transformer
- Multi-Content Complementation Network for Salient Object Detection in Optical Remote Sensing Images
- Review: Deep Learning in Electron Microscopy
- Video Salient Object Detection Using Spatiotemporal Deep Features
- Light Field Salient Object Detection: A Review and Benchmark
- Sound Event Detection and Time-Frequency Segmentation from Weakly Labelled Data
- SAC-Net: Spatial Attenuation Context for Salient Object Detection
- Bilateral Reference for High-Resolution Dichotomous Image Segmentation
- Supervised Saliency Map Driven Segmentation of the Lesions in Dermoscopic Images
- Salient Object Detection with Lossless Feature Reflection and Weighted Structural Loss
- A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trends
- Deeply Supervised Depth Map Super-Resolution as Novel View Synthesis
- Salient Objects in Clutter
- Personal Fixations-Based Object Segmentation with Object Localization and Boundary Preservation
- RGB-D Salient Object Detection with Ubiquitous Target Awareness
- Salient Object Detection via Dynamic Scale Routing
- Hierarchical Convolutional Neural Network with Feature Preservation and Autotuned Thresholding for Crack Detection
- GCoNet+: A Stronger Group Collaborative Co-Salient Object Detector
- An Unsupervised Game-Theoretic Approach to Saliency Detection
- Multi-Granularity Denoising and Bidirectional Alignment for Weakly Supervised Semantic Segmentation
- DFNet: Discriminative feature extraction and integration network for salient object detection
- Boundary-guided Feature Aggregation Network for Salient Object Detection
- Regularized Densely-connected Pyramid Network for Salient Instance Segmentation
- Salient Object Detection in Video using Deep Non-Local Neural Networks
- Seamless Detection: Unifying Salient Object Detection and Camouflaged Object Detection
- Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detection
- Probabilistic Saliency Estimation
- Towards Stable Co-saliency Detection and Object Co-segmentation
- Saliency Detection with Spaces of Background-based Distribution
- 3SHNet: Boosting Image-Sentence Retrieval via Visual Semantic-Spatial Self-Highlighting
- Backtracking Spatial Pyramid Pooling (SPP)-based Image Classifier for Weakly Supervised Top-down Salient Object Detection
- Full-Duplex Strategy for Video Object Segmentation
- Reducing Anomaly Detection in Images to Detection in Noise
- Uncertainty Guided Refinement for Fine-Grained Salient Object Detection
- Saliency Integration: An Arbitrator Model
- Super Diffusion for Salient Object Detection
- Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Tasks
- A Dataset for Provident Vehicle Detection at Night
- CapillaryNet: An Automated System to Quantify Skin Capillary Density and Red Blood Cell Velocity from Handheld Vital Microscopy
- An End-to-End Network for Co-Saliency Detection in One Single Image
- Spatio-Temporal Processing for Automatic Vehicle Detection in Wide-Area Aerial Video
- Automated Design of Salient Object Detection Algorithms with Brain Programming
- Deep Green Function Convolution for Improving Saliency in Convolutional Neural Networks
- Synthetically Trained Icon Proposals for Parsing and Summarizing Infographics
- Rapid Visual Categorization is not Guided by Early Salience-Based Selection
- MPI: Multi-receptive and Parallel Integration for Salient Object Detection
- Salient Object Detection by LTP Texture Characterization on Opposing Color Pairs under SLICO Superpixel Constraint
- Class agnostic moving target detection by color and location prediction of moving area