Efficient transfer entropy analysis of non-stationary neural time series

Abstract

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of interest in neuroscience. Estimating transfer entropy from two processes requires the observation of multiple realizations of these processes to estimate associated probability density functions. To obtain these observations, available estimators assume stationarity of processes to allow pooling of observations over time. This assumption however, is a major obstacle to the application of these estimators in neuroscience as observed processes are often non-stationary. As a solution, Gomez-Herrero and colleagues theoretically showed that the stationarity assumption may be avoided by estimating transfer entropy from an ensemble of realizations. Such an ensemble is often readily available in neuroscience experiments in the form of experimental trials. Thus, in this work we combine the ensemble method with a recently proposed transfer entropy estimator to make transfer entropy estimation applicable to non-stationary time series. We present an efficient implementation of the approach that deals with the increased computational demand of the ensemble method's practical application. In particular, we use a massively parallel implementation for a graphics processing unit to handle the computationally most heavy aspects of the ensemble method. We test the performance and robustness of our implementation on data from simulated stochastic processes and demonstrate the method's applicability to magnetoencephalographic data. While we mainly evaluate the proposed method for neuroscientific data, we expect it to be applicable in a variety of fields that are concerned with the analysis of information transfer in complex biological, social, and artificial systems.

arXiv comment27 pages, 7 figures, submitted to PLOS ONE

References in corpus (17)

• Measuring Information Transfer
• Estimating Mutual Information
• Granger causality and transfer entropy are equivalent for Gaussian variables
• Quantifying unique information
• Local information transfer as a spatiotemporal filter for complex systems
• Nonnegative Decomposition of Multivariate Information
• A Bivariate Measure of Redundant Information
• Differentiating information transfer and causal effect
• The functional structure of cortical neuronal networks grown in vitro
• Information flow between stock indices
• On directed information theory and Granger causality graphs
• Expanding the Transfer Entropy to Identify Information Subgraphs in Complex Systems
• Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems
• Assessing coupling dynamics from an ensemble of time series
• Generalized Measures of Information Transfer
• Towards a Synergy-based Approach to Measuring Information Modification
• Quantifying synergistic mutual information

Cited by in corpus (13)

• Untangling cross-frequency coupling in neuroscience
• JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
• Bits from Biology for Computational Intelligence
• Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing
• Assessing coupling dynamics from an ensemble of time series
• Transfer entropy in continuous time, with applications to jump and neural spiking processes
• Breakdown of local information processing may underlie isoflurane anesthesia effects
• Modes of Information Flow in Collective Cohesion
• A Graph Algorithmic Approach to Separate Direct from Indirect Neural Interactions
• Influence of time delay on information exchanges between coupled linear stochastic systems
• Fourier-domain transfer entropy spectrum
• Identification of pressure points in modern power systems using transfer entropy
• Disentangling causal webs in the brain using functional Magnetic Resonance Imaging: A review of current approaches