A multi-stage GAN for multi-organ chest X-ray image generation and segmentation

Abstract

Multi-organ segmentation of X-ray images is of fundamental importance for computer aided diagnosis systems. However, the most advanced semantic segmentation methods rely on deep learning and require a huge amount of labeled images, which are rarely available due to both the high cost of human resources and the time required for labeling. In this paper, we present a novel multi-stage generation algorithm based on Generative Adversarial Networks (GANs) that can produce synthetic images along with their semantic labels and can be used for data augmentation. The main feature of the method is that, unlike other approaches, generation occurs in several stages, which simplifies the procedure and allows it to be used on very small datasets. The method has been evaluated on the segmentation of chest radiographic images, showing promising results. The multistage approach achieves state-of-the-art and, when very few images are used to train the GANs, outperforms the corresponding single-stage approach.

References in corpus (11)

• Conditional Generative Adversarial Nets
• Conditional Image Synthesis With Auxiliary Classifier GANs
• GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification
• Toward Multimodal Image-to-Image Translation
• SegAN: Adversarial Network with Multi-scale $L_1$ Loss for Medical Image Segmentation
• Unsupervised Learning for Cell-level Visual Representation in Histopathology Images with Generative Adversarial Networks
• Weak Supervision for Generating Pixel-Level Annotations in Scene Text Segmentation
• Unsupervised and semi-supervised learning with Categorical Generative Adversarial Networks assisted by Wasserstein distance for dermoscopy image Classification
• Untangling Local and Global Deformations in Deep Convolutional Networks for Image Classification and Sliding Window Detection
• Towards Robust Lung Segmentation in Chest Radiographs with Deep Learning
• Deform-GAN:An Unsupervised Learning Model for Deformable Registration