Training recurrent neural networks robust to incomplete data: application to Alzheimer's disease progression modeling

Abstract

Disease progression modeling (DPM) using longitudinal data is a challenging machine learning task. Existing DPM algorithms neglect temporal dependencies among measurements, make parametric assumptions about biomarker trajectories, do not model multiple biomarkers jointly, and need an alignment of subjects' trajectories. In this paper, recurrent neural networks (RNNs) are utilized to address these issues. However, in many cases, longitudinal cohorts contain incomplete data, which hinders the application of standard RNNs and requires a pre-processing step such as imputation of the missing values. Instead, we propose a generalized training rule for the most widely used RNN architecture, long short-term memory (LSTM) networks, that can handle both missing predictor and target values. The proposed LSTM algorithm is applied to model the progression of Alzheimer's disease (AD) using six volumetric magnetic resonance imaging (MRI) biomarkers, i.e., volumes of ventricles, hippocampus, whole brain, fusiform, middle temporal gyrus, and entorhinal cortex, and it is compared to standard LSTM networks with data imputation and a parametric, regression-based DPM method. The results show that the proposed algorithm achieves a significantly lower mean absolute error (MAE) than the alternatives with p < 0.05 using Wilcoxon signed rank test in predicting values of almost all of the MRI biomarkers. Moreover, a linear discriminant analysis (LDA) classifier applied to the predicted biomarker values produces a significantly larger AUC of 0.90 vs. at most 0.84 with p < 0.001 using McNemar's test for clinical diagnosis of AD. Inspection of MAE curves as a function of the amount of missing data reveals that the proposed LSTM algorithm achieves the best performance up until more than 74% missing values. Finally, it is illustrated how the method can successfully be applied to data with varying time intervals.

arXiv admin note: substantial text overlap with arXiv:1808.05500

References in corpus (4)

• LSTM: A Search Space Odyssey
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Modeling Missing Data in Clinical Time Series with RNNs
• TADPOLE Challenge: Prediction of Longitudinal Evolution in Alzheimer's Disease

Cited by in corpus (9)

• Handling missing values in healthcare data: A systematic review of deep learning-based imputation techniques
• Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data
• AI for the prediction of early stages of Alzheimer's disease from neuroimaging biomarkers -- A narrative review of a growing field
• On the Initialization of Long Short-Term Memory Networks
• Modeling Continuous Time Sequences with Intermittent Observations using Marked Temporal Point Processes
• MFL_COVID19: Quantifying Country-based Factors affecting Case Fatality Rate in Early Phase of COVID-19 Epidemic via Regularised Multi-task Feature Learning
• Longitudinal Pooling & Consistency Regularization to Model Disease Progression from MRIs
• DeepAtrophy: Teaching a Neural Network to Differentiate Progressive Changes from Noise on Longitudinal MRI in Alzheimer's Disease
• Regional Deep Atrophy: a Self-Supervised Learning Method to Automatically Identify Regions Associated With Alzheimer's Disease Progression From Longitudinal MRI