Medical Matting: A New Perspective on Medical Segmentation with Uncertainty
arXiv:2106.09887
Abstract
It is difficult to accurately label ambiguous and complex shaped targets manually by binary masks. The weakness of binary mask under-expression is highlighted in medical image segmentation, where blurring is prevalent. In the case of multiple annotations, reaching a consensus for clinicians by binary masks is more challenging. Moreover, these uncertain areas are related to the lesions' structure and may contain anatomical information beneficial to diagnosis. However, current studies on uncertainty mainly focus on the uncertainty in model training and data labels. None of them investigate the influence of the ambiguous nature of the lesion itself.Inspired by image matting, this paper introduces alpha matte as a soft mask to represent uncertain areas in medical scenes and accordingly puts forward a new uncertainty quantification method to fill the gap of uncertainty research for lesion structure. In this work, we introduce a new architecture to generate binary masks and alpha mattes in a multitasking framework, which outperforms all state-of-the-art matting algorithms compared. The proposed uncertainty map is able to highlight the ambiguous regions and a novel multitasking loss weighting strategy we presented can improve performance further and demonstrate their concrete benefits. To fully-evaluate the effectiveness of our proposed method, we first labelled three medical datasets with alpha matte to address the shortage of available matting datasets in medical scenes and prove the alpha matte to be a more efficient labeling method than a binary mask from both qualitative and quantitative aspects.
arXiv commentJounal version of our MICCAI 2021 paper, in review
References in corpus (8)
- YOLOv4: Optimal Speed and Accuracy of Object Detection
- What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
- SGDR: Stochastic Gradient Descent with Warm Restarts
- Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks
- Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertainty
- AlphaGAN: Generative adversarial networks for natural image matting
- Hierarchical Opacity Propagation for Image Matting
- , , Alpha Matting