Enhancing Medical Image Registration via Appearance Adjustment Networks

Abstract

Deformable image registration is fundamental for many medical image analyses. A key obstacle for accurate image registration lies in image appearance variations such as the variations in texture, intensities, and noise. These variations are readily apparent in medical images, especially in brain images where registration is frequently used. Recently, deep learning-based registration methods (DLRs), using deep neural networks, have shown computational efficiency that is several orders of magnitude faster than traditional optimization-based registration methods (ORs). DLRs rely on a globally optimized network that is trained with a set of training samples to achieve faster registration. DLRs tend, however, to disregard the target-pair-specific optimization inherent in ORs and thus have degraded adaptability to variations in testing samples. This limitation is severe for registering medical images with large appearance variations, especially since few existing DLRs explicitly take into account appearance variations. In this study, we propose an Appearance Adjustment Network (AAN) to enhance the adaptability of DLRs to appearance variations. Our AAN, when integrated into a DLR, provides appearance transformations to reduce the appearance variations during registration. In addition, we propose an anatomy-constrained loss function through which our AAN generates anatomy-preserving transformations. Our AAN has been purposely designed to be readily inserted into a wide range of DLRs and can be trained cooperatively in an unsupervised and end-to-end manner. We evaluated our AAN with three state-of-the-art DLRs on three well-established public datasets of 3D brain magnetic resonance imaging (MRI). The results show that our AAN consistently improved existing DLRs and outperformed state-of-the-art ORs on registration accuracy, while adding a fractional computational load to existing DLRs.

arXiv commentPublished at NeuroImage

References in corpus (9)

• Adam: A Method for Stochastic Optimization
• TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
• VoxelMorph: A Learning Framework for Deformable Medical Image Registration
• A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration
• Deep Learning in Medical Image Registration: A Survey
• Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registration
• Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfaces
• Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration
• Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Network

Cited by in corpus (4)

• Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration
• AutoFuse: Automatic Fusion Networks for Deformable Medical Image Registration
• Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning
• Brain Tumor Sequence Registration with Non-iterative Coarse-to-fine Networks and Dual Deep Supervision