6 papers
Statistical Dark Matter: Synergy is everywhere but is hard to capture
Alberto Liardi, Fernando E. Rosas, Daniele Marinazzo +3
The information-theoretic construct of synergy refers to the statistical structure that is contained in three or more variables, but not in any subset of them. Here we leverage rec…
Integrated information theory: the good, the bad and the misunderstood
Adam B. Barrett, Borjan Milinkovic, Pedro A. M. Mediano +4
The integrated information theory of consciousness (IIT) is uniquely ambitious in proposing a mathematical formula, derived from apparently fundamental properties of conscious expe…
A Brain-like Synergistic Core in LLMs Drives Behaviour and Learning
Pedro Urbina-Rodriguez, Zafeirios Fountas, Fernando E. Rosas +5
The independent evolution of intelligence in biological and artificial systems offers a unique opportunity to identify its fundamental computational principles. Here we show that l…
Improved estimators of causal emergence for large systems
Madalina I. Sas, Fernando E. Rosas, Hardik Rajpal +3
A central challenge in the study of complex systems is the quantification of emergence -- understood as the ability of the system to exhibit collective behaviours that cannot be tr…
A scalable estimator of higher-order information in complex dynamical systems
Alberto Liardi, George Blackburne, Hardik Rajpal +2
Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have in…
Shannon invariants: A scalable approach to information decomposition
Aaron J. Gutknecht, Fernando E. Rosas, David A. Ehrlich +3
Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns…