Globally Optimal Segmentation of Mutually Interacting Surfaces using Deep Learning

Abstract

Segmentation of multiple surfaces in medical images is a challenging problem, further complicated by the frequent presence of weak boundary and mutual influence between adjacent objects. The traditional graph-based optimal surface segmentation method has proven its effectiveness with its ability of capturing various surface priors in a uniform graph model. However, its efficacy heavily relies on handcrafted features that are used to define the surface cost for the "goodness" of a surface. Recently, deep learning (DL) is emerging as powerful tools for medical image segmentation thanks to its superior feature learning capability. Unfortunately, due to the scarcity of training data in medical imaging, it is nontrivial for DL networks to implicitly learn the global structure of the target surfaces, including surface interactions. In this work, we propose to parameterize the surface cost functions in the graph model and leverage DL to learn those parameters. The multiple optimal surfaces are then simultaneously detected by minimizing the total surface cost while explicitly enforcing the mutual surface interaction constraints. The optimization problem is solved by the primal-dual Internal Point Method, which can be implemented by a layer of neural networks, enabling efficient end-to-end training of the whole network. Experiments on Spectral Domain Optical Coherence Tomography (SD-OCT) retinal layer segmentation and Intravascular Ultrasound (IVUS) vessel wall segmentation demonstrated very promising results. All source code is public to facilitate further research at this direction.

11 pages main content and reference, plus 10 pages appendix, total 21 pages

References in corpus (7)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• A Survey on Deep Learning in Medical Image Analysis
• Distilling the Knowledge in a Neural Network
• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• Topology guaranteed segmentation of the human retina from OCT using convolutional neural networks
• Optimal Surface Segmentation with Convex Priors in Irregularly Sampled Space
• Deep Neural Networks for Surface Segmentation Meet Conditional Random Fields