498 citations · 1.6k across the 46 of their papers we have counts for
14 papers · 1 filter
Statistical Dark Matter: Synergy is everywhere but is hard to capture
Alberto Liardi, Fernando E. Rosas, Daniele Marinazzo +3
The information-theoretic construct of synergy refers to the statistical structure that is contained in three or more variables, but not in any subset of them. Here we leverage rec…
A scalable estimator of higher-order information in complex dynamical systems
Alberto Liardi, George Blackburne, Hardik Rajpal +2
Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have in…
Simple physical systems as a reference for multivariate information dynamics
Alberto Liardi, Madalina I. Sas, George Blackburne +3
Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and…
The topology of synergy: linking topological and information-theoretic approaches to higher-order interactions in complex systems
Thomas F. Varley, Pedro A. M. Mediano, Alice Patania +1
The study of irreducible higher-order interactions has become a core topic of study in complex systems. Two of the most well-developed frameworks, topological data analysis and mul…
Null models for comparing information decomposition across complex systems
Alberto Liardi, Fernando E. Rosas, Robin L. Carhart-Harris +3
A key feature of information theory is its universality, as it can be applied to study a broad variety of complex systems. However, many information-theoretic measures can vary sig…
Characterising high-order interdependence via entropic conjugation
Fernando E. Rosas, Aaron Gutknecht, Pedro A. M. Mediano +1
High-order phenomena play crucial roles in many systems of interest, but their analysis is often highly nontrivial. There is a rich literature providing a number of alternative inf…
The Fast Möbius Transform: An algebraic approach to information decomposition
Abel Jansma, Pedro A. M. Mediano, Fernando E. Rosas
The partial information decomposition (PID) and its extension integrated information decomposition (ID) are promising frameworks to investigate information phenomena involving m…
Algebraic Representations of Entropy and Fixed-Parity Information Quantities
Keenan J. A. Down, Pedro A. M. Mediano
Many information-theoretic quantities have corresponding representations in terms of sets. The prevailing signed measure space for characterising entropy, the -measure of Yeung,…
A Logarithmic Decomposition and a Signed Measure Space for Entropy
Keenan J. A. Down, Pedro A. M. Mediano
The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets,…
Characterising directed and undirected metrics of high-order interdependence
Fernando E. Rosas, Pedro A. M. Mediano, Michael Gastpar
Systems of interest for theoretical or experimental work often exhibit high-order interactions, corresponding to statistical interdependencies in groups of variables that cannot be…
A Logarithmic Decomposition for Information
Keenan J. A. Down, Pedro A. M. Mediano
The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has concretized this connection by defining a signed measure on an…
Disentangling high-order mechanisms and high-order behaviours in complex systems
Fernando E. Rosas, Pedro A. M. Mediano, Andrea I. Luppi +5
Battiston et al. (arXiv:2110.06023) provide a comprehensive overview of how investigations of complex systems should take into account interactions between more than two elements,…
An operational information decomposition via synergistic disclosure
Fernando Rosas, Pedro Mediano, Borzoo Rassouli +1
Multivariate information decompositions hold promise to yield insight into complex systems, and stand out for their ability to identify synergistic phenomena. However, the adoption…
Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Information
Fernando Rosas, Pedro A. M. Mediano, Michael Gastpar +1
This article introduces a model-agnostic approach to study statistical synergy, a form of emergence in which patterns at large scales are not traceable from lower scales. Our frame…