One-shot Joint Extraction, Registration and Segmentation of Neuroimaging Data
arXiv:2307.15198 · doi:10.1145/3580305.3599452
Abstract
Brain extraction, registration and segmentation are indispensable preprocessing steps in neuroimaging studies. The aim is to extract the brain from raw imaging scans (i.e., extraction step), align it with a target brain image (i.e., registration step) and label the anatomical brain regions (i.e., segmentation step). Conventional studies typically focus on developing separate methods for the extraction, registration and segmentation tasks in a supervised setting. The performance of these methods is largely contingent on the quantity of training samples and the extent of visual inspections carried out by experts for error correction. Nevertheless, collecting voxel-level labels and performing manual quality control on high-dimensional neuroimages (e.g., 3D MRI) are expensive and time-consuming in many medical studies. In this paper, we study the problem of one-shot joint extraction, registration and segmentation in neuroimaging data, which exploits only one labeled template image (a.k.a. atlas) and a few unlabeled raw images for training. We propose a unified end-to-end framework, called JERS, to jointly optimize the extraction, registration and segmentation tasks, allowing feedback among them. Specifically, we use a group of extraction, registration and segmentation modules to learn the extraction mask, transformation and segmentation mask, where modules are interconnected and mutually reinforced by self-supervision. Empirical results on real-world datasets demonstrate that our proposed method performs exceptionally in the extraction, registration and segmentation tasks. Our code and data can be found at https://github.com/Anonymous4545/JERS
arXiv commentPublished as a research track paper at KDD 2023. Code: https://github.com/Anonymous4545/JERS
References in corpus (9)
- Attention U-Net: Learning Where to Look for the Pancreas
- Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
- An Unsupervised Learning Model for Deformable Medical Image Registration
- Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registration
- Recursive Cascaded Networks for Unsupervised Medical Image Registration
- Deep Representations for Time-varying Brain Datasets
- Recurrent Multi-view Alignment Network for Unsupervised Surface Registration
- ERNet: Unsupervised Collective Extraction and Registration in Neuroimaging Data
- ABN: Anti-Blur Neural Networks for Multi-Stage Deformable Image Registration