TotalSegmentator: robust segmentation of 104 anatomical structures in CT images

Abstract

We present a deep learning segmentation model that can automatically and robustly segment all major anatomical structures in body CT images. In this retrospective study, 1204 CT examinations (from the years 2012, 2016, and 2020) were used to segment 104 anatomical structures (27 organs, 59 bones, 10 muscles, 8 vessels) relevant for use cases such as organ volumetry, disease characterization, and surgical or radiotherapy planning. The CT images were randomly sampled from routine clinical studies and thus represent a real-world dataset (different ages, pathologies, scanners, body parts, sequences, and sites). The authors trained an nnU-Net segmentation algorithm on this dataset and calculated Dice similarity coefficients (Dice) to evaluate the model's performance. The trained algorithm was applied to a second dataset of 4004 whole-body CT examinations to investigate age dependent volume and attenuation changes. The proposed model showed a high Dice score (0.943) on the test set, which included a wide range of clinical data with major pathologies. The model significantly outperformed another publicly available segmentation model on a separate dataset (Dice score, 0.932 versus 0.871, respectively). The aging study demonstrated significant correlations between age and volume and mean attenuation for a variety of organ groups (e.g., age and aortic volume; age and mean attenuation of the autochthonous dorsal musculature). The developed model enables robust and accurate segmentation of 104 anatomical structures. The annotated dataset (https://doi.org/10.5281/zenodo.6802613) and toolkit (https://www.github.com/wasserth/TotalSegmentator) are publicly available.

Accepted at Radiology: Artificial Intelligence

Cited by in corpus (45)

• Segment Anything Model for Medical Images?
• CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection
• TotalSegmentator MRI: Robust Sequence-independent Segmentation of Multiple Anatomic Structures in MRI
• CLIP in Medical Imaging: A Survey
• MultiTalent: A Multi-Dataset Approach to Medical Image Segmentation
• MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision
• Merlin: A Computed Tomography Vision-Language Foundation Model and Dataset
• Benchmarking Deep Learning-Based Low-Dose CT Image Denoising Algorithms
• SPINEPS -- Automatic Whole Spine Segmentation of T2-weighted MR images using a Two-Phase Approach to Multi-class Semantic and Instance Segmentation
• CT-Mamba: A Hybrid Convolutional State Space Model for Low-Dose CT Denoising
• Deep Models for Multi-View 3D Object Recognition: A Review
• MambaMIM: Pre-training Mamba with State Space Token Interpolation and its Application to Medical Image Segmentation
• MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT
• Deep Learning Segmentation of Ascites on Abdominal CT Scans for Automatic Volume Quantification
• Segmentation-Free Outcome Prediction from Head and Neck Cancer PET/CT Images: Deep Learning-Based Feature Extraction from Multi-Angle Maximum Intensity Projections (MA-MIPs)
• The TopCoW Challenge -- Topology-Aware Circle of Willis Segmentation for CT and MR Angiography
• Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins
• Multimodal Integration of Longitudinal Noninvasive Diagnostics for Survival Prediction in Immunotherapy Using Deep Learning
• A-Eval: A Benchmark for Cross-Dataset Evaluation of Abdominal Multi-Organ Segmentation
• Zero-shot 3D Segmentation of Abdominal Organs in CT Scans Using Segment Anything Model 2: Adapting Video Tracking Capabilities for 3D Medical Imaging
• ONCOPILOT: A Promptable CT Foundation Model For Solid Tumor Evaluation
• Generalist Models in Medical Image Segmentation: A Survey and Performance Comparison with Task-Specific Approaches
• Virtual Reality-Based Preoperative Planning for Optimized Trocar Placement in Thoracic Surgery: A Preliminary Study
• MRAnnotator: multi-Anatomy and many-Sequence MRI segmentation of 44 structures
• Multisensory extended reality applications offer benefits for volumetric biomedical image analysis in research and medicine
• Cut to the Mix: Simple Data Augmentation Outperforms Elaborate Ones in Limited Organ Segmentation Datasets
• Mask the Unknown: Assessing Different Strategies to Handle Weak Annotations in the MICCAI2023 Mediastinal Lymph Node Quantification Challenge
• COIN: Counterfactual inpainting for weakly supervised semantic segmentation for medical images
• Anatomical feature-prioritized loss for enhanced MR to CT translation
• Interpretable Auto Window Setting for Deep-Learning-Based CT Analysis
• Patient-Specific CT Doses Using DL-based Image Segmentation and GPU-based Monte Carlo Calculations for 10,281 Subjects
• FedGIN: Federated Learning with Dynamic Global Intensity Non-linear Augmentation for Organ Segmentation using Multi-modal Images
• Quantitative evaluation of unsupervised clustering algorithms for dynamic total-body PET image analysis
• Calibration and Uncertainty for multiRater Volume Assessment in multiorgan Segmentation (CURVAS) challenge results
• Anatomically Informed GREIT Reconstruction: Improving EIT Imaging for Lung Monitoring
• Automated segmentation of pediatric neuroblastoma on multi-modal MRI: Results of the SPPIN challenge at MICCAI 2023
• Improve Cross-Modality Segmentation by Treating T1-Weighted MRI Images as Inverted CT Scans
• Parallel Swin Transformer-Enhanced 3D MRI-to-CT Synthesis for MRI-Only Radiotherapy Planning
• Advancing Positron Emission Tomography Image Quantification: Artificial Intelligence-Driven Methods, Clinical Challenges, and Emerging Opportunities in Long-Axial Field-of-View Positron Emission Tomography/Computed Tomography Imaging
• KEVS: Enhancing Segmentation of Visceral Adipose Tissue in Pre-Cystectomy CT with Gaussian Kernel Density Estimation
• Large Intestine 3D Shape Refinement Using Point Diffusion Models for Digital Phantom Generation
• A method for supervoxel-wise association studies of age and other non-imaging variables from coronary computed tomography angiograms
• Clinically Interpretable Survival Risk Stratification in Head and Neck Cancer Using Bayesian Networks and Markov Blankets
• Hybrid Foveated Path Tracing with Peripheral Gaussians for Immersive Anatomy
• Beyond one-hot encoding? Journey into compact encoding for large multi-class segmentation