Out-of-distribution data supervision towards biomedical semantic segmentation

Abstract

Biomedical segmentation networks easily suffer from the unexpected misclassification between foreground and background objects when learning on limited and imperfect medical datasets. Inspired by the strong power of Out-of-Distribution (OoD) data on other visual tasks, we propose a data-centric framework, Med-OoD to address this issue by introducing OoD data supervision into fully-supervised biomedical segmentation with none of the following needs: (i) external data sources, (ii) feature regularization objectives, (iii) additional annotations. Our method can be seamlessly integrated into segmentation networks without any modification on the architectures. Extensive experiments show that Med-OoD largely prevents various segmentation networks from the pixel misclassification on medical images and achieves considerable performance improvements on Lizard dataset. We also present an emerging learning paradigm of training a medical segmentation network completely using OoD data devoid of foreground class labels, surprisingly turning out 76.1% mIoU as test result. We hope this learning paradigm will attract people to rethink the roles of OoD data. Code is made available at https://github.com/StudioYG/Med-OoD.

This paper was published in Proceedings of SPIE Volume 13442 and is reprinted with permission. The official version is available at https://doi.org/10.1117/12.3052988. One personal copy is allowed. Reproduction, distribution, or commercial use is prohibited

References in corpus (14)

• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• Scaling Laws for Neural Language Models
• TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation
• Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets
• Mine yOur owN Anatomy: Revisiting Medical Image Segmentation with Extremely Limited Labels
• Revisiting Neural Scaling Laws in Language and Vision
• Scaling Laws For Deep Learning Based Image Reconstruction
• Data-Centric Artificial Intelligence
• Medical Image Segmentation via Unsupervised Convolutional Neural Network
• Understanding Rare Spurious Correlations in Neural Networks
• Exploiting the Potential of Datasets: A Data-Centric Approach for Model Robustness
• Nuisances via Negativa: Adjusting for Spurious Correlations via Data Augmentation
• The Value of Out-of-Distribution Data
• Removing Undesirable Feature Contributions Using Out-of-Distribution Data