Longitudinal Deep Kernel Gaussian Process Regression
arXiv:2005.11770
Abstract
Gaussian processes offer an attractive framework for predictive modeling from longitudinal data, i.e., irregularly sampled, sparse observations from a set of individuals over time. However, such methods have two key shortcomings: (i) They rely on ad hoc heuristics or expensive trial and error to choose the effective kernels, and (ii) They fail to handle multilevel correlation structure in the data. We introduce Longitudinal deep kernel Gaussian process regression (L-DKGPR), which to the best of our knowledge, is the only method to overcome these limitations by fully automating the discovery of complex multilevel correlation structure from longitudinal data. Specifically, L-DKGPR eliminates the need for ad hoc heuristics or trial and error using a novel adaptation of deep kernel learning that combines the expressive power of deep neural networks with the flexibility of non-parametric kernel methods. L-DKGPR effectively learns the multilevel correlation with a novel addictive kernel that simultaneously accommodates both time-varying and the time-invariant effects. We derive an efficient algorithm to train L-DKGPR using latent space inducing points and variational inference. Results of extensive experiments on several benchmark data sets demonstrate that L-DKGPR significantly outperforms the state-of-the-art longitudinal data analysis (LDA) methods.
arXiv commentPaper accepted by 35th AAAI Conference on Artificial Intelligence
References in corpus (9)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- Empirical Evaluation of Rectified Activations in Convolutional Network
- Additive Gaussian Processes
- Stochastic Variational Deep Kernel Learning
- Continuously Differentiable Exponential Linear Units
- TADPOLE Challenge: Prediction of Longitudinal Evolution in Alzheimer's Disease
- Rates of Convergence for Sparse Variational Gaussian Process Regression
- Orthogonally Decoupled Variational Gaussian Processes
- Explainable Multivariate Time Series Classification: A Deep Neural Network Which Learns To Attend To Important Variables As Well As Informative Time Intervals