Pseudo-healthy synthesis with pathology disentanglement and adversarial learning

Abstract

Pseudo-healthy synthesis is the task of creating a subject-specific `healthy' image from a pathological one. Such images can be helpful in tasks such as anomaly detection and understanding changes induced by pathology and disease. In this paper, we present a model that is encouraged to disentangle the information of pathology from what seems to be healthy. We disentangle what appears to be healthy and where disease is as a segmentation map, which are then recombined by a network to reconstruct the input disease image. We train our models adversarially using either paired or unpaired settings, where we pair disease images and maps when available. We quantitatively and subjectively, with a human study, evaluate the quality of pseudo-healthy images using several criteria. We show in a series of experiments, performed on ISLES, BraTS and Cam-CAN datasets, that our method is better than several baselines and methods from the literature. We also show that due to better training processes we could recover deformations, on surrounding tissue, caused by disease. Our implementation is publicly available at https://github.com/xiat0616/pseudo-healthy-synthesis. This paper has been accepted by Medical Image Analysis: https://doi.org/10.1016/j.media.2020.101719.

This paper has been accepted by Medical Image Analysis

References in corpus (4)

• Conditional Generative Adversarial Nets
• CycleGAN, a Master of Steganography
• Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery
• Adversarial Pseudo Healthy Synthesis Needs Pathology Factorization

Cited by in corpus (11)

• Adversarial Attack Vulnerability of Medical Image Analysis Systems: Unexplored Factors
• Learning Disentangled Representations in the Imaging Domain
• Evaluation of pseudo-healthy image reconstruction for anomaly detection with deep generative models: Application to brain FDG PET
• Decomposing Normal and Abnormal Features of Medical Images for Content-based Image Retrieval
• Detecting Outliers with Poisson Image Interpolation
• Generator Versus Segmentor: Pseudo-healthy Synthesis
• Adversarial cycle-consistent synthesis of cerebral microbleeds for data augmentation
• Decomposing Normal and Abnormal Features of Medical Images into Discrete Latent Codes for Content-Based Image Retrieval
• Unsupervised Anomaly Detection in MR Images using Multi-Contrast Information
• Where is the disease? Semi-supervised pseudo-normality synthesis from an abnormal image
• Semi-supervised Pathology Segmentation with Disentangled Representations