Organ At Risk Segmentation with Multiple Modality

Abstract

With the development of image segmentation in computer vision, biomedical image segmentation have achieved remarkable progress on brain tumor segmentation and Organ At Risk (OAR) segmentation. However, most of the research only uses single modality such as Computed Tomography (CT) scans while in real world scenario doctors often use multiple modalities to get more accurate result. To better leverage different modalities, we have collected a large dataset consists of 136 cases with CT and MR images which diagnosed with nasopharyngeal cancer. In this paper, we propose to use Generative Adversarial Network to perform CT to MR transformation to synthesize MR images instead of aligning two modalities. The synthesized MR can be jointly trained with CT to achieve better performance. In addition, we use instance segmentation model to extend the OAR segmentation task to segment both organs and tumor region. The collected dataset will be made public soon.

References in corpus (9)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
• Focal Loss for Dense Object Detection
• BEGAN: Boundary Equilibrium Generative Adversarial Networks
• Learning to Segment Object Candidates
• NiftyNet: a deep-learning platform for medical imaging
• Automatic Brain Tumor Segmentation using Cascaded Anisotropic Convolutional Neural Networks
• Fully Convolutional Instance-aware Semantic Segmentation