Transfer entropy computation using the Perron-Frobenius operator

Abstract

We propose a method for computing the transfer entropy between time series using Ulam's approximation of the Perron-Frobenius (transfer) operator associated with the map generating the dynamics. Our method differs from standard transfer entropy estimators in that the invariant measure is estimated not directly from the data points but from the invariant distribution of the transfer operator approximated from the data points. For sparse time series and low embedding dimension, the transfer operator is approximated using a triangulation of the attractor, whereas for data-rich time series or higher embedding dimension we use a faster grid approach. We compare the performance of our methods with existing estimators such as the k nearest neighbors method and kernel density estimation method, using coupled instances of well known chaotic systems: coupled logistic maps and a coupled Rössler-Lorenz system. We find that our estimators are robust against moderate levels of noise. For sparse time series with less than a hundred observations and low embedding dimension, our triangulation estimator shows improved ability to detect coupling directionality, relative to standard transfer entropy estimators.

arXiv comment21 pages, 25 figures, 6 appendices

References in corpus (12)

• Measuring Information Transfer
• Estimating Mutual Information
• A "missing" family of classical orthogonal polynomials
• Dynamical ensembles in stationary states
• Learning Driver-Response Relationships from Synchronization Patterns
• Direct coupling information measure from non-uniform embedding
• The relation between Granger causality and directed information theory: a review
• Chaotic hypothesis: Onsager reciprocity and fluctuation-dissipation theorem
• Time-resolved and time-scale adaptive measures of spike train synchrony
• Hierarchical Coupled Geometry Analysis for Neuronal Structure and Activity Pattern Discovery
• Identifying delayed directional couplings with symbolic transfer entropy
• Lagrangian Flow Network approach to an open flow model

Cited by in corpus (2)

• Estimating fractal dimensions: a comparative review and open source implementations
• A robust estimator of mutual information for deep learning interpretability