Deep Learning in Medical Image Registration: A Survey

Abstract

The establishment of image correspondence through robust image registration is critical to many clinical tasks such as image fusion, organ atlas creation, and tumor growth monitoring, and is a very challenging problem. Since the beginning of the recent deep learning renaissance, the medical imaging research community has developed deep learning based approaches and achieved the state-of-the-art in many applications, including image registration. The rapid adoption of deep learning for image registration applications over the past few years necessitates a comprehensive summary and outlook, which is the main scope of this survey. This requires placing a focus on the different research areas as well as highlighting challenges that practitioners face. This survey, therefore, outlines the evolution of deep learning based medical image registration in the context of both research challenges and relevant innovations in the past few years. Further, this survey highlights future research directions to show how this field may be possibly moved forward to the next level.

arXiv commentAccepted for publication by Machine Vision and Applications on January 8, 2020

References in corpus (13)

• Deep Learning in Neural Networks: An Overview
• A Survey on Deep Learning in Medical Image Analysis
• Image reconstruction by domain transform manifold learning
• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• PCANet: A Simple Deep Learning Baseline for Image Classification?
• Phase recovery and holographic image reconstruction using deep learning in neural networks
• A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration
• An Unsupervised Learning Model for Deformable Medical Image Registration
• Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registration
• End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
• Learning Deep Similarity Metric for 3D MR-TRUS Registration
• Label-driven weakly-supervised learning for multimodal deformable image registration
• ssEMnet: Serial-section Electron Microscopy Image Registration using a Spatial Transformer Network with Learned Features

Cited by in corpus (31)

• A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises
• Recent advances and clinical applications of deep learning in medical image analysis
• Local Feature Matching Using Deep Learning: A Survey
• Is attention all you need in medical image analysis? A review
• A coarse-to-fine framework for unsupervised multi-contrast MR image deformable registration with dual consistency constraint
• Deep Learning for Retrospective Motion Correction in MRI: A Comprehensive Review
• Early Melanoma Diagnosis with Sequential Dermoscopic Images
• PathoNet: Deep learning assisted evaluation of Ki-67 and tumor infiltrating lymphocytes (TILs) as prognostic factors in breast cancer; A large dataset and baseline
• Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration
• From Screens to Scenes: A Survey of Embodied AI in Healthcare
• AutoFuse: Automatic Fusion Networks for Deformable Medical Image Registration
• Robust deformable image registration using cycle-consistent implicit representations
• Enhancing Medical Image Registration via Appearance Adjustment Networks
• Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning
• Is Image-to-Image Translation the Panacea for Multimodal Image Registration? A Comparative Study
• RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challenge
• Comparison of Consecutive and Re-stained Sections for Image Registration in Histopathology
• A Sub-pixel Accurate Quantification of Joint Space Narrowing Progression in Rheumatoid Arthritis
• Domain adaptation strategies for 3D reconstruction of the lumbar spine using real fluoroscopy data
• A Two-Step Deep Learning Method for 3DCT-2DUS Kidney Registration During Breathing
• Brain Tumor Sequence Registration with Non-iterative Coarse-to-fine Networks and Dual Deep Supervision
• Deep learning based registration using spatial gradients and noisy segmentation labels
• The use of deep learning in interventional radiotherapy (brachytherapy): a review with a focus on open source and open data
• ConKeD: Multiview contrastive descriptor learning for keypoint-based retinal image registration
• Deep Implicit Optimization enables Robust Learnable Features for Deformable Image Registration
• Registration of serial sections: An evaluation method based on distortions of the ground truths
• Deformable Image Registration using Unsupervised Deep Learning for CBCT-guided Abdominal Radiotherapy
• Deformable registration with intensity correction for CESM monitoring response to Neoadjuvant Chemotherapy
• Deep Learning -- A first Meta-Survey of selected Reviews across Scientific Disciplines, their Commonalities, Challenges and Research Impact
• Employing similarity to highlight differences: On the impact of anatomical assumptions in chest X-ray registration methods
• Advancing biological super-resolution microscopy through deep learning: a brief review