Simple U-net Based Synthetic Polyp Image Generation: Polyp to Negative and Negative to Polyp

Abstract

Synthetic polyp generation is a good alternative to overcome the privacy problem of medical data and the lack of various polyp samples. In this study, we propose a deep learning-based polyp image generation framework that generates synthetic polyp images that are similar to real ones. We suggest a framework that converts a given polyp image into a negative image (image without a polyp) using a simple conditional GAN architecture and then converts the negative image into a new-looking polyp image using the same network. In addition, by using the controllable polyp masks, polyps with various characteristics can be generated from one input condition. The generated polyp images can be used directly as training images for polyp detection and segmentation without additional labeling. To quantitatively assess the quality of generated synthetic polyps, we use public polyp image and video datasets combined with the generated synthetic images to examine the performance improvement of several detection and segmentation models. Experimental results show that we obtain performance gains when the generated polyp images are added to the training set.

References in corpus (7)

• Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
• TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation
• Unsupervised Reverse Domain Adaptation for Synthetic Medical Images via Adversarial Training
• Automatic Colon Polyp Detection using Region based Deep CNN and Post Learning Approaches
• Abnormal Colon Polyp Image Synthesis Using Conditional Adversarial Networks for Improved Detection Performance
• Angiodysplasia Detection and Localization Using Deep Convolutional Neural Networks
• Polyp Detection and Segmentation using Mask R-CNN: Does a Deeper Feature Extractor CNN Always Perform Better?

Cited by in corpus (3)

• This Intestine Does Not Exist: Multiscale Residual Variational Autoencoder for Realistic Wireless Capsule Endoscopy Image Generation
• Polyp-Gen: Realistic and Diverse Polyp Image Generation for Endoscopic Dataset Expansion
• Multiscale Vector-Quantized Variational Autoencoder for Endoscopic Image Synthesis