Orders between channels and implications for partial information decomposition
arXiv:2305.06021 · doi:10.3390/e25070975
Abstract
The partial information decomposition (PID) framework is concerned with decomposing the information that a set of random variables has with respect to a target variable into three types of components: redundant, synergistic, and unique. Classical information theory alone does not provide a unique way to decompose information in this manner and additional assumptions have to be made. Recently, Kolchinsky proposed a new general axiomatic approach to obtain measures of redundant information, based on choosing an order relation between information sources (equivalently, order between communication channels). In this paper, we exploit this approach to introduce three new measures of redundant information (and the resulting decompositions) based on well-known preorders between channels, thus contributing to the enrichment of the PID landscape. We relate the new decompositions to existing ones, study some of their properties, and provide examples illustrating their novelty. As a side result, we prove that any preorder that satisfies Kolchinsky's axioms yields a decomposition that meets the axioms originally introduced by Williams and Beer when they first propose the PID.
13 pages, 1 figure
References in corpus (18)
- Quantum information can be negative
- Quantifying unique information
- Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
- A Bivariate Measure of Redundant Information
- Measuring multivariate redundant information with pointwise common change in surprisal
- Control of complex networks requires both structure and dynamics
- Intersection Information based on Common Randomness
- Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems
- Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
- Pointwise Partial Information Decomposition using the Specificity and Ambiguity Lattices
- A Novel Approach to the Partial Information Decomposition
- Redundancy and synergy in dual decompositions of mutual information gain and information loss
- Towards a Synergy-based Approach to Measuring Information Modification
- Quantifying Redundant Information in Predicting a Target Random Variable
- Secret Sharing and Shared Information
- Reconsidering unique information: Towards a multivariate information decomposition
- On extractable shared information
- Coarse-graining and the Blackwell order