Non-rigid image registration using fully convolutional networks with deep self-supervision

Abstract

We propose a novel non-rigid image registration algorithm that is built upon fully convolutional networks (FCNs) to optimize and learn spatial transformations between pairs of images to be registered. Different from most existing deep learning based image registration methods that learn spatial transformations from training data with known corresponding spatial transformations, our method directly estimates spatial transformations between pairs of images by maximizing an image-wise similarity metric between fixed and deformed moving images, similar to conventional image registration algorithms. At the same time, our method also learns FCNs for encoding the spatial transformations at the same spatial resolution of images to be registered, rather than learning coarse-grained spatial transformation information. The image registration is implemented in a multi-resolution image registration framework to jointly optimize and learn spatial transformations and FCNs at different resolutions with deep self-supervision through typical feedforward and backpropagation computation. Since our method simultaneously optimizes and learns spatial transformations for the image registration, our method can be directly used to register a pair of images, and the registration of a set of images is also a training procedure for FCNs so that the trained FCNs can be directly adopted to register new images by feedforward computation of the learned FCNs without any optimization. The proposed method has been evaluated for registering 3D structural brain magnetic resonance (MR) images and obtained better performance than state-of-the-art image registration algorithms.

References in corpus (4)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• TensorFlow: A system for large-scale machine learning
• ssEMnet: Serial-section Electron Microscopy Image Registration using a Spatial Transformer Network with Learned Features

Cited by in corpus (19)

• Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfaces
• Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration
• Recursive Cascaded Networks for Unsupervised Medical Image Registration
• When Deep Learning Meets Data Alignment: A Review on Deep Registration Networks (DRNs)
• Anatomy-aware and acquisition-agnostic joint registration with SynthMorph
• Non-Rigid Image Registration Using Self-Supervised Fully Convolutional Networks without Training Data
• FAIM -- A ConvNet Method for Unsupervised 3D Medical Image Registration
• Networks for Joint Affine and Non-parametric Image Registration
• Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retina OCT Images
• Region-specific Diffeomorphic Metric Mapping
• On Reducing Negative Jacobian Determinant of the Deformation Predicted by Deep Registration Networks
• Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow
• ABN: Anti-Blur Neural Networks for Multi-Stage Deformable Image Registration
• A Comparative Study for Non-rigid Image Registration and Rigid Image Registration
• MDReg-Net: Multi-resolution diffeomorphic image registration using fully convolutional networks with deep self-supervision
• A Spatiotemporal Volumetric Interpolation Network for 4D Dynamic Medical Image
• JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D Multi-Modal Image Alignment of Large-scale Pathological CT Scans
• ACEnet: Anatomical Context-Encoding Network for Neuroanatomy Segmentation
• Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Images