Information Flow Rate for Cross-Correlated Stochastic Processes

Abstract

Causal inference seeks to identify cause-and-effect interactions in coupled systems. A recently proposed method by Liang detects causal relations by quantifying the direction and magnitude of information flow between time series. The theoretical formulation of information flow for stochastic dynamical systems provides a general expression and a data-driven statistic for the rate of entropy transfer between different system units. To advance understanding of information flow rate in terms of intuitive concepts and physically meaningful parameters, we investigate statistical properties of the data-driven information flow rate between coupled stochastic processes. We derive relations between the expectation of the information flow rate statistic and properties of the auto- and cross-correlation functions. Thus, we elucidate the dependence of the information flow rate on the analytical properties and characteristic times of the correlation functions. Our analysis provides insight into the influence of the sampling step, the strength of cross-correlations, and the temporal delay of correlations on information flow rate. We support the theoretical results with numerical simulations of correlated Gaussian processes.

arXiv comment16 pages, 5 figures; to appear in IEEE Transactions on Signal Processing

References in corpus (10)

• Measuring Information Transfer
• Granger causality and transfer entropy are equivalent for Gaussian variables
• Detecting causal associations in large nonlinear time series datasets
• Kernel method for nonlinear Granger causality
• Cross-Covariance Functions for Multivariate Geostatistics
• Normalizing the causality between time series
• Granger Causality in Multi-variate Time Series using a Time Ordered Restricted Vector Autoregressive Model
• Multivariate Gaussian and Student$-t$ Process Regression for Multi-output Prediction
• Quantum Liang Information Flow as Causation Quantifier
• Non-separable Covariance Kernels for Spatiotemporal Gaussian Processes based on a Hybrid Spectral Method and the Harmonic Oscillator