MAXENT3D_PID: An Estimator for the Maximum-entropy Trivariate Partial Information Decomposition
arXiv:1901.03352 · doi:10.3390/e21090862
Abstract
Chicharro (2017) introduced a procedure to determine multivariate partial information measures within the maximum entropy framework, separating unique, redundant, and synergistic components of information. Makkeh, Theis, and Vicente (2018) formulated the latter trivariate partial information measure as Cone Programming. In this paper, we present MAXENT3D_PID, a production-quality software that computes the trivariate partial information measure based on the Cone Programming model. We describe in detail our software, explain how to use it, and perform some experiments reflecting its accuracy in estimating the trivariate partial information decomposition.
References in corpus (29)
- Measuring Information Transfer
- JIDT: An information-theoretic toolkit for studying the dynamics of complex systems
- Network information and connected correlations
- Quantifying unique information
- Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
- A Bivariate Measure of Redundant Information
- Partial Information Decomposition as a Unified Approach to the Specification of Neural Goal Functions
- Measuring multivariate redundant information with pointwise common change in surprisal
- Prediction of spatio-temporal patterns of neural activity from pairwise correlations
- Bits from Biology for Computational Intelligence
- Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes
- Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems
- Pointwise Partial Information Decomposition using the Specificity and Ambiguity Lattices
- Multivariate Dependence Beyond Shannon Information
- Invariant components of synergy, redundancy, and unique information among three variables
- Redundancy and synergy in dual decompositions of mutual information gain and information loss
- Towards a Synergy-based Approach to Measuring Information Modification
- Synergetic and redundant information flow detected by unnormalized Granger causality: application to resting state fMRI
- Identifying Coupling Structure in Complex Systems through the Optimal Causation Entropy Principle
- Secret Sharing and Shared Information
- Quantifying how much sensory information in a neural code is relevant for behavior
- BROJA-2PID: A robust estimator for bivariate partial information decomposition
- Unique Information and Secret Key Agreement
- On extractable shared information
- Computing the Unique Information
- Exact partial information decompositions for Gaussian systems based on dependency constraints
- Robustness, Canalyzing Functions and Systems Design
- The identity of information: how deterministic dependencies constrain information synergy and redundancy
- MAXENT3D_PID: An Estimator for the Maximum-entropy Trivariate Partial Information Decomposition