Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review

Abstract

Deep learning has become a popular tool for medical image analysis, but the limited availability of training data remains a major challenge, particularly in the medical field where data acquisition can be costly and subject to privacy regulations. Data augmentation techniques offer a solution by artificially increasing the number of training samples, but these techniques often produce limited and unconvincing results. To address this issue, a growing number of studies have proposed the use of deep generative models to generate more realistic and diverse data that conform to the true distribution of the data. In this review, we focus on three types of deep generative models for medical image augmentation: variational autoencoders, generative adversarial networks, and diffusion models. We provide an overview of the current state of the art in each of these models and discuss their potential for use in different downstream tasks in medical imaging, including classification, segmentation, and cross-modal translation. We also evaluate the strengths and limitations of each model and suggest directions for future research in this field. Our goal is to provide a comprehensive review about the use of deep generative models for medical image augmentation and to highlight the potential of these models for improving the performance of deep learning algorithms in medical image analysis.

References in corpus (20)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Conditional Generative Adversarial Nets
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• Diffusion Models Beat GANs on Image Synthesis
• Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
• Score-Based Generative Modeling through Stochastic Differential Equations
• Zero-Shot Text-to-Image Generation
• CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection
• Tackling the Generative Learning Trilemma with Denoising Diffusion GANs
• StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesis
• RoentGen: Vision-Language Foundation Model for Chest X-ray Generation
• Conversion Between CT and MRI Images Using Diffusion and Score-Matching Models
• On Fast Sampling of Diffusion Probabilistic Models
• A Quantitative Comparison between Shannon and Tsallis Havrda Charvat Entropies Applied to Cancer Outcome Prediction
• A Novel Unified Conditional Score-based Generative Framework for Multi-modal Medical Image Completion
• Improving dermatology classifiers across populations using images generated by large diffusion models
• The Swiss Army Knife for Image-to-Image Translation: Multi-Task Diffusion Models
• Spot the fake lungs: Generating Synthetic Medical Images using Neural Diffusion Models
• Bi-parametric prostate MR image synthesis using pathology and sequence-conditioned stable diffusion

Cited by in corpus (7)

• Generative AI for Synthetic Data Across Multiple Medical Modalities: A Systematic Review of Recent Developments and Challenges
• Similarity and Quality Metrics for MR Image-To-Image Translation
• Data Augmentation for Seizure Prediction with Generative Diffusion Model
• Discriminative Hamiltonian Variational Autoencoder for Accurate Tumor Segmentation in Data-Scarce Regimes
• Robust and Explainable Framework to Address Data Scarcity in Diagnostic Imaging
• End-to-end autoencoding architecture for the simultaneous generation of medical images and corresponding segmentation masks
• Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generation