Structure-measure: A New Way to Evaluate Foreground Maps

Abstract

Foreground map evaluation is crucial for gauging the progress of object segmentation algorithms, in particular in the filed of salient object detection where the purpose is to accurately detect and segment the most salient object in a scene. Several widely-used measures such as Area Under the Curve (AUC), Average Precision (AP) and the recently proposed Fbw have been utilized to evaluate the similarity between a non-binary saliency map (SM) and a ground-truth (GT) map. These measures are based on pixel-wise errors and often ignore the structural similarities. Behavioral vision studies, however, have shown that the human visual system is highly sensitive to structures in scenes. Here, we propose a novel, efficient, and easy to calculate measure known an structural similarity measure (Structure-measure) to evaluate non-binary foreground maps. Our new measure simultaneously evaluates region-aware and object-aware structural similarity between a SM and a GT map. We demonstrate superiority of our measure over existing ones using 5 meta-measures on 5 benchmark datasets.

Accepted by ICCV 2017

References in corpus (3)

• Visual Saliency Based on Multiscale Deep Features
• What is a salient object? A dataset and a baseline model for salient object detection
• Deep Contrast Learning for Salient Object Detection

Cited by in corpus (14)

• Fast Camouflaged Object Detection via Edge-based Reversible Re-calibration Network
• BTS-DSN: Deeply Supervised Neural Network with Short Connections for Retinal Vessel Segmentation
• Advances in Deep Concealed Scene Understanding
• Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Network
• Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground
• Effectiveness Assessment of Recent Large Vision-Language Models
• Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models
• Camouflaged Object Segmentation with Distraction Mining
• Contrast-weighted Dictionary Learning Based Saliency Detection for Remote Sensing Images
• Learning Synergistic Attention for Light Field Salient Object Detection
• Salient Object Detection by Lossless Feature Reflection
• Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusion
• HyperFusion-Net: Densely Reflective Fusion for Salient Object Detection
• Guidance and Teaching Network for Video Salient Object Detection