3D Segmentation Guided Style-based Generative Adversarial Networks for PET Synthesis

Abstract

Potential radioactive hazards in full-dose positron emission tomography (PET) imaging remain a concern, whereas the quality of low-dose images is never desirable for clinical use. So it is of great interest to translate low-dose PET images into full-dose. Previous studies based on deep learning methods usually directly extract hierarchical features for reconstruction. We notice that the importance of each feature is different and they should be weighted dissimilarly so that tiny information can be captured by the neural network. Furthermore, the synthesis on some regions of interest is important in some applications. Here we propose a novel segmentation guided style-based generative adversarial network (SGSGAN) for PET synthesis. (1) We put forward a style-based generator employing style modulation, which specifically controls the hierarchical features in the translation process, to generate images with more realistic textures. (2) We adopt a task-driven strategy that couples a segmentation task with a generative adversarial network (GAN) framework to improve the translation performance. Extensive experiments show the superiority of our overall framework in PET synthesis, especially on those regions of interest.

arXiv commentThis article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TMI.2022.3156614, IEEE Transactions on Medical Imaging

References in corpus (5)

• Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)
• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• MedGAN: Medical Image Translation using GANs
• Brain MRI Super Resolution Using 3D Deep Densely Connected Neural Networks
• Constrained Deep Weak Supervision for Histopathology Image Segmentation

Cited by in corpus (2)

• Inflating 2D Convolution Weights for Efficient Generation of 3D Medical Images
• Image2Points:A 3D Point-based Context Clusters GAN for High-Quality PET Image Reconstruction