Iterative fully convolutional neural networks for automatic vertebra segmentation and identification

Abstract

Precise segmentation and anatomical identification of the vertebrae provides the basis for automatic analysis of the spine, such as detection of vertebral compression fractures or other abnormalities. Most dedicated spine CT and MR scans as well as scans of the chest, abdomen or neck cover only part of the spine. Segmentation and identification should therefore not rely on the visibility of certain vertebrae or a certain number of vertebrae. We propose an iterative instance segmentation approach that uses a fully convolutional neural network to segment and label vertebrae one after the other, independently of the number of visible vertebrae. This instance-by-instance segmentation is enabled by combining the network with a memory component that retains information about already segmented vertebrae. The network iteratively analyzes image patches, using information from both image and memory to search for the next vertebra. To efficiently traverse the image, we include the prior knowledge that the vertebrae are always located next to each other, which is used to follow the vertebral column. This method was evaluated with five diverse datasets, including multiple modalities (CT and MR), various fields of view and coverages of different sections of the spine, and a particularly challenging set of low-dose chest CT scans. The proposed iterative segmentation method compares favorably with state-of-the-art methods and is fast, flexible and generalizable.

arXiv commentAccepted for publication in Medical Image Analysis

References in corpus (6)

• A Survey on Deep Learning in Medical Image Analysis
• Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation
• Automatic segmentation of MR brain images with a convolutional neural network
• 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
• Joint Vertebrae Identification and Localization in Spinal CT Images by Combining Short- and Long-Range Contextual Information
• Automatic Vertebra Labeling in Large-Scale 3D CT using Deep Image-to-Image Network with Message Passing and Sparsity Regularization

Cited by in corpus (13)

• VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Images
• Lumbar spine segmentation in MR images: a dataset and a public benchmark
• CLIP in Medical Imaging: A Survey
• CTSpine1K: A Large-Scale Dataset for Spinal Vertebrae Segmentation in Computed Tomography
• Advances in Medical Image Segmentation: A Comprehensive Survey with a Focus on Lumbar Spine Applications
• Sequential Rib Labeling and Segmentation in Chest X-Ray using Mask R-CNN
• Permutohedral Attention Module for Efficient Non-Local Neural Networks
• 3D Segmentation Networks for Excessive Numbers of Classes: Distinct Bone Segmentation in Upper Bodies
• Technical Report: Quality Assessment Tool for Machine Learning with Clinical CT
• Employing similarity to highlight differences: On the impact of anatomical assumptions in chest X-ray registration methods
• Random smooth gray value transformations for cross modality learning with gray value invariant networks
• Two-Stream Compare and Contrast Network for Vertebral Compression Fracture Diagnosis
• Automatic Segmentation, Localization, and Identification of Vertebrae in 3D CT Images Using Cascaded Convolutional Neural Networks