PyMIC: A deep learning toolkit for annotation-efficient medical image segmentation

Abstract

Background and Objective: Open-source deep learning toolkits are one of the driving forces for developing medical image segmentation models. Existing toolkits mainly focus on fully supervised segmentation and require full and accurate pixel-level annotations that are time-consuming and difficult to acquire for segmentation tasks, which makes learning from imperfect labels highly desired for reducing the annotation cost. We aim to develop a new deep learning toolkit to support annotation-efficient learning for medical image segmentation. Methods: Our proposed toolkit named PyMIC is a modular deep learning library for medical image segmentation tasks. In addition to basic components that support development of high-performance models for fully supervised segmentation, it contains several advanced components tailored for learning from imperfect annotations, such as loading annotated and unannounced images, loss functions for unannotated, partially or inaccurately annotated images, and training procedures for co-learning between multiple networks, etc. PyMIC supports development of semi-supervised, weakly supervised and noise-robust learning methods for medical image segmentation. Results: We present several illustrative medical image segmentation tasks based on PyMIC: (1) Achieving competitive performance on fully supervised learning; (2) Semi-supervised cardiac structure segmentation with only 10% training images annotated; (3) Weakly supervised segmentation using scribble annotations; and (4) Learning from noisy labels for chest radiograph segmentation. Conclusions: The PyMIC toolkit is easy to use and facilitates efficient development of medical image segmentation models with imperfect annotations. It is modular and flexible, which enables researchers to develop high-performance models with low annotation cost. The source code is available at: https://github.com/HiLab-git/PyMIC.

arXiv comment12 pages, 6 figures

References in corpus (13)

• Automated Design of Deep Learning Methods for Biomedical Image Segmentation
• Domain Adaptation for Medical Image Analysis: A Survey
• CA-Net: Comprehensive Attention Convolutional Neural Networks for Explainable Medical Image Segmentation
• TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning
• NiftyNet: a deep-learning platform for medical imaging
• Annotation-efficient deep learning for automatic medical image segmentation
• Mumford-Shah Loss Functional for Image Segmentation with Deep Learning
• Learning to Segment from Scribbles using Multi-scale Adversarial Attention Gates
• Semi-Supervised Segmentation of Radiation-Induced Pulmonary Fibrosis from Lung CT Scans with Multi-Scale Guided Dense Attention
• DLTK: State of the Art Reference Implementations for Deep Learning on Medical Images
• Gated CRF Loss for Weakly Supervised Semantic Image Segmentation
• pymia: A Python package for data handling and evaluation in deep learning-based medical image analysis
• SenseCare: A Research Platform for Medical Image Informatics and Interactive 3D Visualization

Cited by in corpus (3)

• UPL-SFDA: Uncertainty-aware Pseudo Label Guided Source-Free Domain Adaptation for Medical Image Segmentation
• Enhancing the vision-language foundation model with key semantic knowledge-emphasized report refinement
• ATOMMIC: An Advanced Toolbox for Multitask Medical Imaging Consistency to facilitate Artificial Intelligence applications from acquisition to analysis in Magnetic Resonance Imaging