On shared and multiple information
arXiv:2107.11032 · doi:10.13140/RG.2.2.27408.33289
Abstract
We address three outstanding problems in information theory. Problem one is the definition of a non-negative decomposition of the information conveyed by two or more sources about a target variable into the specific contribution of each possible combination of the sources. Problem two is the definition of a measure of information shared by several sources about the target variable. Problem three is the definition of a measure of multiple mutual information, that is, the extension of mutual information to more than two variables.
arXiv commentAdded proof of additivity property
References in corpus (6)
- Nonnegative Decomposition of Multivariate Information
- A Bivariate Measure of Redundant Information
- Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems
- Multivariate Dependence Beyond Shannon Information
- Redundancy and synergy in dual decompositions of mutual information gain and information loss
- Quantifying Redundant Information in Predicting a Target Random Variable