Conditional Diffusion Models for Semantic 3D Brain MRI Synthesis

Abstract

Artificial intelligence (AI) in healthcare, especially in medical imaging, faces challenges due to data scarcity and privacy concerns. Addressing these, we introduce Med-DDPM, a diffusion model designed for 3D semantic brain MRI synthesis. This model effectively tackles data scarcity and privacy issues by integrating semantic conditioning. This involves the channel-wise concatenation of a conditioning image to the model input, enabling control in image generation. Med-DDPM demonstrates superior stability and performance compared to existing 3D brain imaging synthesis methods. It generates diverse, anatomically coherent images with high visual fidelity. In terms of dice score accuracy in the tumor segmentation task, Med-DDPM achieves 0.6207, close to the 0.6531 accuracy of real images, and outperforms baseline models. Combined with real images, it further increases segmentation accuracy to 0.6675, showing the potential of our proposed method for data augmentation. This model represents the first use of a diffusion model in 3D semantic brain MRI synthesis, producing high-quality images. Its semantic conditioning feature also shows potential for image anonymization in biomedical imaging, addressing data and privacy issues. We provide the code and model weights for Med-DDPM on our GitHub repository (https://github.com/mobaidoctor/med-ddpm/) to support reproducibility.

This document is a preprint and has been accepted for publication in the IEEE Journal of Biomedical and Health Informatics. The final, published version can be accessed using the following DOI: 10.1109/JBHI.2024.3385504. Copyright for this article has been transferred to IEEE

References in corpus (2)

• Diffusion Models Beat GANs on Image Synthesis
• Med3D: Transfer Learning for 3D Medical Image Analysis

Cited by in corpus (9)

• Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing
• Polyp-DDPM: Diffusion-Based Semantic Polyp Synthesis for Enhanced Segmentation
• Deformation-Recovery Diffusion Model (DRDM): Instance Deformation for Image Manipulation and Synthesis
• Parallel Swin Transformer-Enhanced 3D MRI-to-CT Synthesis for MRI-Only Radiotherapy Planning
• Lung-DDPM+: Efficient Thoracic CT Image Synthesis using Diffusion Probabilistic Model
• 3D Conditional Image Synthesis of Left Atrial LGE MRI from Composite Semantic Masks
• Performance Analysis and Optimization of 3D Generative Diffusion Models across GPU Architectures
• Impact of Synthetic Lesional MR Images in Automated Focal Cortical Dysplasia Detection in Low-Data Scenarios
• Structural MRI Synthesis for Alzheimer's Disease via Conditional Diffusion on Anatomical Masks