SinGAN-Seg: Synthetic training data generation for medical image segmentation

Abstract

Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic processing of medical data, acting as a supportive tool for doctors. However, the machine learning models used to build these tools are highly dependent on the data used to train them. Large amounts of data can be difficult to obtain in medicine due to privacy, expensive and time-consuming annotations, and a general lack of data samples for infrequent lesions. Here, we present a novel synthetic data generation pipeline, called SinGAN-Seg, to produce synthetic medical images with corresponding masks using a single training image. Our method is different from the traditional GANs because our model needs only a single image and the corresponding ground truth to train. Our method produces alternative artificial segmentation datasets with ground truth masks when real datasets are not allowed to share. The pipeline is evaluated using qualitative and quantitative comparisons between real and synthetic data to show that the style transfer technique used in our pipeline significantly improves the quality of the generated data and our method is better than other state-of-the-art GANs to prepare synthetic images when the size of training datasets are limited. By training UNet++ using both real and the synthetic data generated from the SinGAN-Seg pipeline, we show that models trained with synthetic data have very close performances to those trained on real data when the datasets have a considerable amount of data. In contrast, Synthetic data generated from the SinGAN-Seg pipeline can improve the performance of segmentation models when training datasets do not have a considerable amount of data. The code is available on GitHub.

References in corpus (9)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning
• Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesis
• Abnormal Colon Polyp Image Synthesis Using Conditional Adversarial Networks for Improved Detection Performance
• Polyp Detection and Segmentation from Video Capsule Endoscopy: A Review
• Pyramid-Focus-Augmentation: Medical Image Segmentation with Step-Wise Focus
• Human-guided Robot Behavior Learning: A GAN-assisted Preference-based Reinforcement Learning Approach
• DivergentNets: Medical Image Segmentation by Network Ensemble

Cited by in corpus (10)

• Data synthesis and adversarial networks: A review and meta-analysis in cancer imaging
• A Survey on Deep Learning for Polyp Segmentation: Techniques, Challenges and Future Trends
• medigan: a Python library of pretrained generative models for medical image synthesis
• Polyp-DDPM: Diffusion-Based Semantic Polyp Synthesis for Enhanced Segmentation
• Joint one-sided synthetic unpaired image translation and segmentation for colorectal cancer prevention
• Polyp-Gen: Realistic and Diverse Polyp Image Generation for Endoscopic Dataset Expansion
• Frontiers in Intelligent Colonoscopy
• GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation
• Leveraging Modified Ex Situ Tomography Data for Segmentation of In Situ Synchrotron X-Ray Computed Tomography
• ORGAN: Object-Centric Representation Learning using Cycle Consistent Generative Adversarial Networks