A Measure of Synergy based on Union Information

Abstract

The partial information decomposition (PID) framework is concerned with decomposing the information that a set of (two or more) random variables (the sources) has about another variable (the target) into three types of information: unique, redundant, and synergistic. Classical information theory alone does not provide a unique way to decompose information in this manner and additional assumptions have to be made. One often overlooked way to achieve this decomposition is using a so-called measure of union information - which quantifies the information that is present in at least one of the sources - from which a synergy measure stems. In this paper, we introduce a new measure of union information based on adopting a communication channel perspective, compare it with existing measures, and study some of its properties. We also include a comprehensive critical review of characterizations of union information and synergy measures that have been proposed in the literature.

References in corpus (17)

• Quantifying unique information
• Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
• A Bivariate Measure of Redundant Information
• Measuring multivariate redundant information with pointwise common change in surprisal
• Intersection Information based on Common Randomness
• Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
• A Novel Approach to the Partial Information Decomposition
• Redundancy and synergy in dual decompositions of mutual information gain and information loss
• Towards a Synergy-based Approach to Measuring Information Modification
• An operational information decomposition via synergistic disclosure
• Quantifying synergistic information using intermediate stochastic variables
• Quantifying Redundant Information in Predicting a Target Random Variable
• A comparison of partial information decompositions using data from real and simulated layer 5b pyramidal cells
• Secret Sharing and Shared Information
• Unique Information and Secret Key Agreement
• Coarse-graining and the Blackwell order
• Orders between channels and implications for partial information decomposition