End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network

Abstract

In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet analyzes a pair of fixed and moving images and outputs parameters for the spatial transformer, which generates the displacement vector field that enables the resampler to warp the moving image to the fixed image. The DIRNet is trained end-to-end by unsupervised optimization of a similarity metric between input image pairs. A trained DIRNet can be applied to perform registration on unseen image pairs in one pass, thus non-iteratively. Evaluation was performed with registration of images of handwritten digits (MNIST) and cardiac cine MR scans (Sunnybrook Cardiac Data). The results demonstrate that registration with DIRNet is as accurate as a conventional deformable image registration method with substantially shorter execution times.

References in corpus (2)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• An Artificial Agent for Robust Image Registration

Cited by in corpus (63)

• VoxelMorph: A Learning Framework for Deformable Medical Image Registration
• A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration
• TransMorph: Transformer for unsupervised medical image registration
• Deep Learning in Medical Image Registration: A Review
• An Unsupervised Learning Model for Deformable Medical Image Registration
• Deep Learning in Medical Image Registration: A Survey
• Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfaces
• Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registration
• The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches
• Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration
• Recursive Cascaded Networks for Unsupervised Medical Image Registration
• Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Network
• Learning a Probabilistic Model for Diffeomorphic Registration
• SynthMorph: learning contrast-invariant registration without acquired images
• Direct Automatic Coronary Calcium Scoring in Cardiac and Chest CT
• Label-driven weakly-supervised learning for multimodal deformable image registration
• Learning Deformable Registration of Medical Images with Anatomical Constraints
• Learning Conditional Deformable Templates with Convolutional Networks
• Correcting rural building annotations in OpenStreetMap using convolutional neural networks
• Medical image registration using unsupervised deep neural network: A scoping literature review
• Developing Brain Atlas through Deep Learning
• AIRNet: Self-Supervised Affine Registration for 3D Medical Images using Neural Networks
• Adversarial Deformation Regularization for Training Image Registration Neural Networks
• LAPNet: Non-rigid Registration derived in k-space for Magnetic Resonance Imaging
• Robust Multimodal Image Registration Using Deep Recurrent Reinforcement Learning
• Anatomy-aware and acquisition-agnostic joint registration with SynthMorph
• Generating Anthropomorphic Phantoms Using Fully Unsupervised Deformable Image Registration with Convolutional Neural Networks
• FDRN: A Fast Deformable Registration Network for Medical Images
• Attention-aware non-rigid image registration for accelerated MR imaging
• GAN Based Medical Image Registration
• CartiMorph: a framework for automated knee articular cartilage morphometrics
• A probabilistic deep learning model of inter-fraction anatomical variations in radiotherapy
• Stroke Extraction of Chinese Character Based on Deep Structure Deformable Image Registration
• Generative Aging of Brain Images with Diffeomorphic Registration
• Temporal Interpolation via Motion Field Prediction
• Adversarial Image Registration with Application for MR and TRUS Image Fusion
• Registration of Histopathogy Images Using Structural Information From Fine Grained Feature Maps
• Cine Cardiac MRI Motion Artifact Reduction Using a Recurrent Neural Network
• Zero Shot Learning for Multi-Modal Real Time Image Registration
• Cross-modal Attention for MRI and Ultrasound Volume Registration
• Neural Multi-Scale Self-Supervised Registration for Echocardiogram Dense Tracking
• INSPIRE: Intensity and spatial information-based deformable image registration
• NeurReg: Neural Registration and Its Application to Image Segmentation
• Test-Time Training for Deformable Multi-Scale Image Registration
• Region-specific Diffeomorphic Metric Mapping
• Fast Learning-based Registration of Sparse 3D Clinical Images
• ABN: Anti-Blur Neural Networks for Multi-Stage Deformable Image Registration
• A training-free recursive multiresolution framework for diffeomorphic deformable image registration
• Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow
• Synthesizing Individualized Aging Brains in Health and Disease with Generative Models and Parallel Transport
• Performance Assessment of Feature Detection Methods for 2-D FS Sonar Imagery
• Synth-by-Reg (SbR): Contrastive learning for synthesis-based registration of paired images
• JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-Modal Image Alignment of Large-scale Pathological CT Scans
• Training Data Independent Image Registration With GANs Using Transfer Learning And Segmentation Information
• Generative Adversarial Networks And Domain Adaptation For Training Data Independent Image Registration
• Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Images
• Finite-Sample Analysis of Image Registration
• Deep Learning based Inter-Modality Image Registration Supervised by Intra-Modality Similarity
• Multi-scale Neural ODEs for 3D Medical Image Registration
• Deep Biomechanically-Guided Interpolation for Keypoint-Based Brain Shift Registration
• Informative sample generation using class aware generative adversarial networks for classification of chest Xrays
• Fast Strain Estimation and Frame Selection in Ultrasound Elastography using Machine Learning
• Anatomical Predictions using Subject-Specific Medical Data