A Deep Learning Approach for Virtual Contrast Enhancement in Contrast Enhanced Spectral Mammography

Abstract

Contrast Enhanced Spectral Mammography (CESM) is a dual-energy mammographic imaging technique that first needs intravenously administration of an iodinated contrast medium; then, it collects both a low-energy image, comparable to standard mammography, and a high-energy image. The two scans are then combined to get a recombined image showing contrast enhancement. Despite CESM diagnostic advantages for breast cancer diagnosis, the use of contrast medium can cause side effects, and CESM also beams patients with a higher radiation dose compared to standard mammography. To address these limitations this work proposes to use deep generative models for virtual contrast enhancement on CESM, aiming to make the CESM contrast-free as well as to reduce the radiation dose. Our deep networks, consisting of an autoencoder and two Generative Adversarial Networks, the Pix2Pix, and the CycleGAN, generate synthetic recombined images solely from low-energy images. We perform an extensive quantitative and qualitative analysis of the model's performance, also exploiting radiologists' assessments, on a novel CESM dataset that includes 1138 images that, as a further contribution of this work, we make publicly available. The results show that CycleGAN is the most promising deep network to generate synthetic recombined images, highlighting the potential of artificial intelligence techniques for virtual contrast enhancement in this field.

References in corpus (1)

• CT Image Denoising with Perceptive Deep Neural Networks

Cited by in corpus (10)

• A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applications
• Multimodal Explainability via Latent Shift applied to COVID-19 stratification
• A graph neural network-based model with Out-of-Distribution Robustness for enhancing Antiretroviral Therapy Outcome Prediction for HIV-1
• Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twin
• Augmented Intelligence for Multimodal Virtual Biopsy in Breast Cancer Using Generative Artificial Intelligence
• Beyond a Single Mode: GAN Ensembles for Diverse Medical Data Generation
• Timing Is Everything: Finding the Optimal Fusion Points in Multimodal Medical Imaging
• Any-to-Any Vision-Language Model for Multimodal X-ray Imaging and Radiological Report Generation
• Evaluating Vision Language Model Adaptations for Radiology Report Generation in Low-Resource Languages
• Virtual Scanning for NSCLC Histology: Investigating the Discriminatory Power of Synthetic PET