Partial Information Decomposition of Boolean Functions: a Fourier Analysis perspective
arXiv:2010.06976
Abstract
Partial information decomposition (PID) partitions the information that a set of sources has about a target variable into synergistic, unique, and redundant contributions. This information-theoretic tool has recently attracted attention due to its potential to characterize the information processing in multivariate systems. However, the PID framework still lacks a solid and intuitive interpretation of its information components. In the aim to improve the understanding of PID components, we focus here on Boolean gates, a much-studied type of source-target mechanisms. Boolean gates have been extensively characterised via Fourier analysis which coefficients have been related to interesting properties of the functions defining the gates. In this paper, we establish for Boolean gates mechanisms a relation between their PID components and Fourier coefficients.
arXiv comment24 pages; 1 figure
References in corpus (14)
- The information bottleneck method
- Quantifying unique information
- Nonnegative Decomposition of Multivariate Information
- Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
- A Bivariate Measure of Redundant Information
- Partial Information Decomposition as a Unified Approach to the Specification of Neural Goal Functions
- Prediction of spatio-temporal patterns of neural activity from pairwise correlations
- Shared Information -- New Insights and Problems in Decomposing Information in Complex Systems
- Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
- Redundancy and synergy in dual decompositions of mutual information gain and information loss
- Introducing a differentiable measure of pointwise shared information
- Robustness, Canalyzing Functions and Systems Design
- Quantifying multivariate redundancy with maximum entropy decompositions of mutual information
- Optimizing Bivariate Partial Information Decomposition