HSMix: Hard and Soft Mixing Data Augmentation for Medical Image Segmentation

Abstract

Due to the high cost of annotation or the rarity of some diseases, medical image segmentation is often limited by data scarcity and the resulting overfitting problem. Self-supervised learning and semi-supervised learning can mitigate the data scarcity challenge to some extent. However, both of these paradigms are complex and require either hand-crafted pretexts or well-defined pseudo-labels. In contrast, data augmentation represents a relatively simple and straightforward approach to addressing data scarcity issues. It has led to significant improvements in image recognition tasks. However, the effectiveness of local image editing augmentation techniques in the context of segmentation has been less explored. We propose HSMix, a novel approach to local image editing data augmentation involving hard and soft mixing for medical semantic segmentation. In our approach, a hard-augmented image is created by combining homogeneous regions (superpixels) from two source images. A soft mixing method further adjusts the brightness of these composed regions with brightness mixing based on locally aggregated pixel-wise saliency coefficients. The ground-truth segmentation masks of the two source images undergo the same mixing operations to generate the associated masks for the augmented images. Our method fully exploits both the prior contour and saliency information, thus preserving local semantic information in the augmented images while enriching the augmentation space with more diversity. Our method is a plug-and-play solution that is model agnostic and applicable to a range of medical imaging modalities. Extensive experimental evidence has demonstrated its effectiveness in a variety of medical segmentation tasks. The source code is available in https://github.com/DanielaPlusPlus/HSMix.

References in corpus (13)

• A Survey on Deep Learning in Medical Image Analysis
• Attention U-Net: Learning Where to Look for the Pancreas
• TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
• Road Extraction by Deep Residual U-Net
• Segment Anything in Medical Images
• Improved Regularization of Convolutional Neural Networks with Cutout
• GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification
• The Medical Segmentation Decathlon
• Joint Optic Disc and Cup Segmentation Based on Multi-label Deep Network and Polar Transformation
• Self-supervised learning methods and applications in medical imaging analysis: A survey
• PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image Segmentation
• GuidedMixup: An Efficient Mixup Strategy Guided by Saliency Maps
• Local and Global Context-and-Object-part-Aware Superpixel-based Data Augmentation for Deep Visual Recognition

Cited by in corpus (1)

• Intuitive Axial Augmentation Using Polar-Sine-Based Piecewise Distortion for Medical Slice-Wise Segmentation