Quantifying Redundant Information in Predicting a Target Random Variable
arXiv:1411.4732 · doi:10.3390/e17074644
Abstract
This paper considers the problem of defining a measure of redundant information that quantifies how much common information two or more random variables specify about a target random variable. We discussed desired properties of such a measure, and propose new measures with some desirable properties.
arXiv comment6 pages, 6 figures
References in corpus (7)
- Network information and connected correlations
- Quantifying unique information
- Nonnegative Decomposition of Multivariate Information
- A Bivariate Measure of Redundant Information
- Intersection Information based on Common Randomness
- Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems
- Towards a Synergy-based Approach to Measuring Information Modification
Cited by in corpus (12)
- Measuring multivariate redundant information with pointwise common change in surprisal
- Pointwise Partial Information Decomposition using the Specificity and Ambiguity Lattices
- Decomposing causality into its synergistic, unique, and redundant components
- A Novel Approach to the Partial Information Decomposition
- Generalised Measures of Multivariate Information Content
- Synergy, Redundancy and Common Information
- Orders between channels and implications for partial information decomposition
- A Measure of Synergy based on Union Information
- On shared and multiple information
- Explicit Formula for Partial Information Decomposition
- Partial information decomposition: redundancy as information bottleneck
- An Approximation Scheme for Multivariate Information based on Partial Information Decomposition