Efficient transfer entropy analysis of non-stationary neural time series

Abstract

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of interest in neuroscience. Estimating transfer entropy from two processes requires the observation of multiple realizations of these processes to estimate associated probability density functions. To obtain these observations, available estimators assume stationarity of processes to allow pooling of observations over time. This assumption however, is a major obstacle to the application of these estimators in neuroscience as observed processes are often non-stationary. As a solution, Gomez-Herrero and colleagues theoretically showed that the stationarity assumption may be avoided by estimating transfer entropy from an ensemble of realizations. Such an ensemble is often readily available in neuroscience experiments in the form of experimental trials. Thus, in this work we combine the ensemble method with a recently proposed transfer entropy estimator to make transfer entropy estimation applicable to non-stationary time series. We present an efficient implementation of the approach that deals with the increased computational demand of the ensemble method's practical application. In particular, we use a massively parallel implementation for a graphics processing unit to handle the computationally most heavy aspects of the ensemble method. We test the performance and robustness of our implementation on data from simulated stochastic processes and demonstrate the method's applicability to magnetoencephalographic data. While we mainly evaluate the proposed method for neuroscientific data, we expect it to be applicable in a variety of fields that are concerned with the analysis of information transfer in complex biological, social, and artificial systems.

27 pages, 7 figures, submitted to PLOS ONE

References in corpus (6)

• Quantifying unique information
• Local information transfer as a spatiotemporal filter for complex systems
• Nonnegative Decomposition of Multivariate Information
• The functional structure of cortical neuronal networks grown in vitro
• Information flow between stock indices
• Generalized Measures of Information Transfer

Cited by in corpus (12)

• Untangling cross-frequency coupling in neuroscience
• JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
• Bits from Biology for Computational Intelligence
• Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing
• Transfer entropy in continuous time, with applications to jump and neural spiking processes
• Breakdown of local information processing may underlie isoflurane anesthesia effects
• A Graph Algorithmic Approach to Separate Direct from Indirect Neural Interactions
• Modes of Information Flow in Collective Cohesion
• Influence of time delay on information exchanges between coupled linear stochastic systems
• Fourier-domain transfer entropy spectrum
• Disentangling causal webs in the brain using functional Magnetic Resonance Imaging: A review of current approaches
• Identification of pressure points in modern power systems using transfer entropy