Spatio-Temporal Structured Sparse Regression with Hierarchical Gaussian Process Priors

Abstract

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies between the components of the sparse signal of interest. A hierarchical Gaussian process describes such structure and the interdependencies are represented via the covariance matrices of the prior distributions. The inference is based on the expectation propagation method and the theoretical derivation of the posterior distribution is provided in the paper. The inference framework is thoroughly evaluated over synthetic, real video and electroencephalography (EEG) data where the spatio-temporal evolving patterns need to be reconstructed with high accuracy. It is shown that it achieves 15% improvement of the F-measure compared with the alternating direction method of multipliers, spatio-temporal sparse Bayesian learning method and one-level Gaussian process model. Additionally, the required memory for the proposed algorithm is less than in the one-level Gaussian process model. This structured sparse regression framework is of broad applicability to source localisation and object detection problems with sparse signals.

References in corpus (11)

• Expectation Propagation for approximate Bayesian inference
• Structured Compressed Sensing: From Theory to Applications
• Sparse Signal Recovery with Temporally Correlated Source Vectors Using Sparse Bayesian Learning
• C-HiLasso: A Collaborative Hierarchical Sparse Modeling Framework
• Maximal Sparsity with Deep Networks?
• Spatiotemporal Sparse Bayesian Learning with Applications to Compressed Sensing of Multichannel Physiological Signals
• Adaptive-Rate Compressive Sensing Using Side Information
• Bayesian inference for spatio-temporal spike-and-slab priors
• Bayesian and L1 Approaches to Sparse Unsupervised Learning
• Bayesian Structured Sparsity from Gaussian Fields
• Regularizing Solutions to the MEG Inverse Problem Using Space-Time Separable Covariance Functions

Cited by in corpus (2)

• Modeling of Spatio-Temporal Hawkes Processes with Randomized Kernels
• Learning Temporal Evolution of Spatial Dependence with Generalized Spatiotemporal Gaussian Process Models