Distribution-aware Margin Calibration for Semantic Segmentation in Images

Abstract

The Jaccard index, also known as Intersection-over-Union (IoU), is one of the most critical evaluation metrics in image semantic segmentation. However, direct optimization of IoU score is very difficult because the learning objective is neither differentiable nor decomposable. Although some algorithms have been proposed to optimize its surrogates, there is no guarantee provided for the generalization ability. In this paper, we propose a margin calibration method, which can be directly used as a learning objective, for an improved generalization of IoU over the data-distribution, underpinned by a rigid lower bound. This scheme theoretically ensures a better segmentation performance in terms of IoU score. We evaluated the effectiveness of the proposed margin calibration method on seven image datasets, showing substantial improvements in IoU score over other learning objectives using deep segmentation models.

This paper has been accepted by International Journal of Computer Vision (IJCV), and published on 09 November 2021. arXiv admin note: text overlap with arXiv:2011.01462

References in corpus (5)

• Fully Convolutional Networks for Semantic Segmentation
• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• Optimization for Medical Image Segmentation: Theory and Practice when evaluating with Dice Score or Jaccard Index
• Striking the Right Balance with Uncertainty
• Learning Surrogate Losses