Convolutional Invasion and Expansion Networks for Tumor Growth Prediction

Abstract

Tumor growth is associated with cell invasion and mass-effect, which are traditionally formulated by mathematical models, namely reaction-diffusion equations and biomechanics. Such models can be personalized based on clinical measurements to build the predictive models for tumor growth. In this paper, we investigate the possibility of using deep convolutional neural networks (ConvNets) to directly represent and learn the cell invasion and mass-effect, and to predict the subsequent involvement regions of a tumor. The invasion network learns the cell invasion from information related to metabolic rate, cell density and tumor boundary derived from multimodal imaging data. The expansion network models the mass-effect from the growing motion of tumor mass. We also study different architectures that fuse the invasion and expansion networks, in order to exploit the inherent correlations among them. Our network can easily be trained on population data and personalized to a target patient, unlike most previous mathematical modeling methods that fail to incorporate population data. Quantitative experiments on a pancreatic tumor data set show that the proposed method substantially outperforms a state-of-the-art mathematical model-based approach in both accuracy and efficiency, and that the information captured by each of the two subnetworks are complementary.

References in corpus (8)

• Two-Stream Convolutional Networks for Action Recognition in Videos
• Unsupervised Learning of Video Representations using LSTMs
• Automatic segmentation of MR brain images with a convolutional neural network
• Improving Computer-aided Detection using Convolutional Neural Networks and Random View Aggregation
• DeepPap: Deep Convolutional Networks for Cervical Cell Classification
• Video (language) modeling: a baseline for generative models of natural videos
• Move Evaluation in Go Using Deep Convolutional Neural Networks
• Predicting Deeper into the Future of Semantic Segmentation

Cited by in corpus (6)

• Prediction of brain tumor recurrence location based on multi-modal fusion and nonlinear correlation learning
• Deformation Driven Seq2Seq Longitudinal Tumor and Organs-at-Risk Prediction for Radiotherapy
• Fine-Grained Classification of Cervical Cells Using Morphological and Appearance Based Convolutional Neural Networks
• Spatio-Temporal Convolutional LSTMs for Tumor Growth Prediction by Learning 4D Longitudinal Patient Data
• A Time Series Graph Cut Image Segmentation Scheme for Liver Tumors
• An Uncertainty-aware Hierarchical Probabilistic Network for Early Prediction, Quantification and Segmentation of Pulmonary Tumour Growth