Pathology-Aware Generative Adversarial Networks for Medical Image Augmentation

Abstract

Convolutional Neural Networks (CNNs) can play a key role in Medical Image Analysis under large-scale annotated datasets. However, preparing such massive dataset is demanding. In this context, Generative Adversarial Networks (GANs) can generate realistic but novel samples, and thus effectively cover the real image distribution. In terms of interpolation, the GAN-based medical image augmentation is reliable because medical modalities can display the human body's strong anatomical consistency at fixed position while clearly reflecting inter-subject variability; thus, we propose to use noise-to-image GANs (e.g., random noise samples to diverse pathological images) for (i) medical Data Augmentation (DA) and (ii) physician training. Regarding the DA, the GAN-generated images can improve Computer-Aided Diagnosis based on supervised learning. For the physician training, the GANs can display novel desired pathological images and help train medical trainees despite infrastructural/legal constraints. This thesis contains four GAN projects aiming to present such novel applications' clinical relevance in collaboration with physicians. Whereas the methods are more generally applicable, this thesis only explores a few oncological applications.

Ph.D. Thesis (The University of Tokyo) defended in February, 2020. Based on GAN-based synthetic brain MR image generation (ISBI 2018), arXiv:1902.09856, arXiv:1903.12564, arXiv:1905.13456, arXiv:1906.04962, arXiv:2001.03923

References in corpus (8)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Improved Regularization of Convolutional Neural Networks with Cutout
• The Effectiveness of Data Augmentation in Image Classification using Deep Learning
• DenseNet: Implementing Efficient ConvNet Descriptor Pyramids
• Med3D: Transfer Learning for 3D Medical Image Analysis
• Learning What and Where to Draw
• Generative Image Translation for Data Augmentation of Bone Lesion Pathology
• Machine learning and AI research for Patient Benefit: 20 Critical Questions on Transparency, Replicability, Ethics and Effectiveness