Generative Adversarial Networks And Domain Adaptation For Training Data Independent Image Registration

Abstract

Medical image registration is an important task in automated analysis of multi-modal images and temporal data involving multiple patient visits. Conventional approaches, although useful for different image types, are time consuming. Of late, deep learning (DL) based image registration methods have been proposed that outperform traditional methods in terms of accuracy and time. However,DL based methods are heavily dependent on training data and do not generalize well when presented with images of different scanners or anatomies. We present a DL based approach that can perform medical image registration of one image type despite being trained with images of a different type. This is achieved by unsupervised domain adaptation in the registration process and allows for easier application to different datasets without extensive retraining.To achieve our objective we train a network that transforms the given input image pair to a latent feature space vector using autoencoders. The resultant encoded feature space is used to generate the registered images with the help of generative adversarial networks (GANs). This feature transformation ensures greater invariance to the input image type. Experiments on chest Xray, retinal and brain MR images show that our method, trained on one dataset gives better registration performance for other datasets, outperforming conventional methods that do not incorporate domain adaptation

References in corpus (10)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
• Unsupervised Visual Feature Learning with Spike-timing-dependent Plasticity: How Far are we from Traditional Feature Learning Approaches?
• Retinal Vasculature Segmentation Using Local Saliency Maps and Generative Adversarial Networks For Image Super Resolution
• Night Time Haze and Glow Removal using Deep Dilated Convolutional Network
• Chest X-rays Classification: A Multi-Label and Fine-Grained Problem
• Progressive Generative Adversarial Networks for Medical Image Super resolution
• GAN Based Medical Image Registration
• Consensus Based Medical Image Segmentation Using Semi-Supervised Learning And Graph Cuts
• sZoom: A Framework for Automatic Zoom into High Resolution Surveillance Videos

Cited by in corpus (2)

• Learning of Inter-Label Geometric Relationships Using Self-Supervised Learning: Application To Gleason Grade Segmentation
• Multimodal Generalized Zero Shot Learning for Gleason Grading using Self-Supervised Learning