Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy

Abstract

Over half a million individuals are diagnosed with head and neck cancer each year worldwide. Radiotherapy is an important curative treatment for this disease, but it requires manual time consuming delineation of radio-sensitive organs at risk (OARs). This planning process can delay treatment, while also introducing inter-operator variability with resulting downstream radiation dose differences. While auto-segmentation algorithms offer a potentially time-saving solution, the challenges in defining, quantifying and achieving expert performance remain. Adopting a deep learning approach, we demonstrate a 3D U-Net architecture that achieves expert-level performance in delineating 21 distinct head and neck OARs commonly segmented in clinical practice. The model was trained on a dataset of 663 deidentified computed tomography (CT) scans acquired in routine clinical practice and with both segmentations taken from clinical practice and segmentations created by experienced radiographers as part of this research, all in accordance with consensus OAR definitions. We demonstrate the model's clinical applicability by assessing its performance on a test set of 21 CT scans from clinical practice, each with the 21 OARs segmented by two independent experts. We also introduce surface Dice similarity coefficient (surface DSC), a new metric for the comparison of organ delineation, to quantify deviation between OAR surface contours rather than volumes, better reflecting the clinical task of correcting errors in the automated organ segmentations. The model's generalisability is then demonstrated on two distinct open source datasets, reflecting different centres and countries to model training. With appropriate validation studies and regulatory approvals, this system could improve the efficiency, consistency, and safety of radiotherapy pathways.

References in corpus (6)

• Adam: A Method for Stochastic Optimization
• Deep Residual Learning for Image Recognition
• AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomy
• Bridging Category-level and Instance-level Semantic Image Segmentation
• Atlas Based Segmentations via Semi-Supervised Diffeomorphic Registrations
• Local block-wise self attention for normal organ segmentation

Cited by in corpus (36)

• Automated Design of Deep Learning Methods for Biomedical Image Segmentation
• The Medical Segmentation Decathlon
• CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentation
• TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning
• AnatomyNet: Deep Learning for Fast and Fully Automated Whole-volume Segmentation of Head and Neck Anatomy
• Modified U-Net (mU-Net) with Incorporation of Object-Dependent High Level Features for Improved Liver and Liver-Tumor Segmentation in CT Images
• CLIP-Driven Universal Model for Organ Segmentation and Tumor Detection
• Robust deep learning-based semantic organ segmentation in hyperspectral images
• Do We Really Need Dice? The Hidden Region-Size Biases of Segmentation Losses
• pymia: A Python package for data handling and evaluation in deep learning-based medical image analysis
• Robust Medical Instrument Segmentation Challenge 2019
• USE-Evaluator: Performance Metrics for Medical Image Segmentation Models with Uncertain, Small or Empty Reference Annotations
• A Hierarchical Probabilistic U-Net for Modeling Multi-Scale Ambiguities
• Assessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedures
• Registration-Guided Deep Learning Image Segmentation for Cone Beam CT-based Online Adaptive Radiotherapy
• AbdomenCT-1K: Is Abdominal Organ Segmentation A Solved Problem?
• Organ at Risk Segmentation for Head and Neck Cancer using Stratified Learning and Neural Architecture Search
• Non-inferiority of Deep Learning Acute Ischemic Stroke Segmentation on Non-Contrast CT Compared to Expert Neuroradiologists
• Deep cross-modality (MR-CT) educed distillation learning for cone beam CT lung tumor segmentation
• SegTHOR: Segmentation of Thoracic Organs at Risk in CT images
• Deep learning in magnetic resonance prostate segmentation: A review and a new perspective
• Does Non-COVID19 Lung Lesion Help? Investigating Transferability in COVID-19 CT Image Segmentation
• Secure Medical Image Analysis with CrypTFlow
• Atlas Based Segmentations via Semi-Supervised Diffeomorphic Registrations
• Automatic Segmentation of Organs-at-Risk from Head-and-Neck CT using Separable Convolutional Neural Network with Hard-Region-Weighted Loss
• Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotations
• Mask-RCNN and U-net Ensembled for Nuclei Segmentation
• Spatial Context-Aware Self-Attention Model For Multi-Organ Segmentation
• Deep Learning for Automated Medical Image Analysis
• A Framework for Challenge Design: Insight and Deployment Challenges to Address Medical Image Analysis Problems
• Anatomically Consistent Segmentation of Organs at Risk in MRI with Convolutional Neural Networks
• Synthetic vascular structure generation for unsupervised pre-training in CTA segmentation tasks
• A Proof-of-Concept Study of Artificial Intelligence Assisted Contour Revision
• Machine learning for automatic construction of pseudo-realistic pediatric abdominal phantoms
• Prognostic Value of Transfer Learning Based Features in Resectable Pancreatic Ductal Adenocarcinoma
• Hoechst Is All You Need: Lymphocyte Classification with Deep Learning