Quantifying high-order interdependencies on individual patterns via the local O-information: theory and applications to music analysis
arXiv:2108.11625 · doi:10.1103/PhysRevResearch.4.013184
Abstract
High-order, beyond-pairwise interdependencies are at the core of biological, economic, and social complex systems, and their adequate analysis is paramount to understand, engineer, and control such systems. This paper presents a framework to measure high-order interdependence that disentangles their effect on each individual pattern exhibited by a multivariate system. The approach is centred on the 'local O-information', a new measure that assesses the balance between synergistic and redundant interdependencies at each pattern. To illustrate the potential of this framework, we present a detailed analysis of music scores from J.S. Bach, which reveals how high-order interdependence is deeply connected with highly non-trivial aspects of the musical discourse. Our results place the local O-information as a promising tool of wide applicability, which opens new perspectives for analysing high-order relationships in the patterns exhibited by complex systems.
arXiv comment14 pages, 10 figures
References in corpus (20)
- Local information transfer as a spatiotemporal filter for complex systems
- Nonnegative Decomposition of Multivariate Information
- Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems
- Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Information
- A Bivariate Measure of Redundant Information
- Partial Information Decomposition as a Unified Approach to the Specification of Neural Goal Functions
- Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate data
- Intersection Information based on Common Randomness
- Bits and Pieces: Understanding Information Decomposition from Part-whole Relationships and Formal Logic
- Pointwise Partial Information Decomposition using the Specificity and Ambiguity Lattices
- Introducing a differentiable measure of pointwise shared information
- Understanding interdependency through complex information sharing
- An operational information decomposition via synergistic disclosure
- Beyond integrated information: A taxonomy of information dynamics phenomena
- Unique Information and Secret Key Agreement
- Generalised Measures of Multivariate Information Content
- The arrow of time across five centuries of classical music
- Local Granger Causality
- The Partial Entropy Decomposition: Decomposing multivariate entropy and mutual information via pointwise common surprisal
- A partial information decomposition for discrete and continuous variables