Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Network

Abstract

3D medical image registration is of great clinical importance. However, supervised learning methods require a large amount of accurately annotated corresponding control points (or morphing), which are very difficult to obtain. Unsupervised learning methods ease the burden of manual annotation by exploiting unlabeled data without supervision. In this paper, we propose a new unsupervised learning method using convolutional neural networks under an end-to-end framework, Volume Tweening Network (VTN), for 3D medical image registration. We propose three innovative technical components: (1) An end-to-end cascading scheme that resolves large displacement; (2) An efficient integration of affine registration network; and (3) An additional invertibility loss that encourages backward consistency. Experiments demonstrate that our algorithm is 880x faster (or 3.3x faster without GPU acceleration) than traditional optimization-based methods and achieves state-of-theart performance in medical image registration.

arXiv commentJournal of Biomedical and Health Informatics

References in corpus (7)

• A Survey on Deep Learning in Medical Image Analysis
• VoxelMorph: A Learning Framework for Deformable Medical Image Registration
• A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration
• An Unsupervised Learning Model for Deformable Medical Image Registration
• End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
• Recursive Cascaded Networks for Unsupervised Medical Image Registration
• Learning a Probabilistic Model for Diffeomorphic Registration

Cited by in corpus (22)

• Recent advances and clinical applications of deep learning in medical image analysis
• Deep Learning in Medical Image Registration: A Review
• Recursive Cascaded Networks for Unsupervised Medical Image Registration
• Medical image registration using unsupervised deep neural network: A scoping literature review
• Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration
• CyTran: A Cycle-Consistent Transformer with Multi-Level Consistency for Non-Contrast to Contrast CT Translation
• IGCN: Image-to-graph Convolutional Network for 2D/3D Deformable Registration
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond
• Enhancing Medical Image Registration via Appearance Adjustment Networks
• Anatomy-aware and acquisition-agnostic joint registration with SynthMorph
• Residual Aligner Network
• Unsupervised inter-frame motion correction for whole-body dynamic PET using convolutional long short-term memory in a convolutional neural network
• RegWSI: Whole Slide Image Registration using Combined Deep Feature- and Intensity-Based Methods: Winner of the ACROBAT 2023 Challenge
• 3D Brain and Heart Volume Generative Models: A Survey
• Recursive Deformable Image Registration Network with Mutual Attention
• A Two-Step Deep Learning Method for 3DCT-2DUS Kidney Registration During Breathing
• Segmentation by Test-Time Optimization (TTO) for CBCT-based Adaptive Radiation Therapy
• Deep Implicit Optimization enables Robust Learnable Features for Deformable Image Registration
• ModeTv2: GPU-accelerated Motion Decomposition Transformer for Pairwise Optimization in Medical Image Registration
• Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matching
• InstantGroup: Instant Template Generation for Scalable Group of Brain MRI Registration
• Unsupervised Deformable Image Registration with Local-Global Attention and Image Decomposition