11 papers
Information Dynamics of Language Communication
Leonardo S. Goodall, Andrea I. Luppi, Pedro A. M. Mediano
Quantifying how meaning propagates through communicative exchanges remains underdeveloped in computational linguistics. Here we introduce an information-theoretic framework that qu…
A scalable estimator of higher-order information in complex dynamical systems
Alberto Liardi, George Blackburne, Hardik Rajpal +2
Our understanding of complex systems rests on our ability to characterise how they perform distributed computation and integrate information. Advances in information theory have in…
Synergistic Motifs in Gaussian Systems
Enrico Caprioglio, Pedro A. M. Mediano, Luc Berthouze
High-order interdependencies are central features of complex systems, yet a mechanistic explanation for their emergence remains elusive. Currently, it is unknown under what conditi…
A Brain-like Synergistic Core in LLMs Drives Behaviour and Learning
Pedro Urbina-Rodriguez, Zafeirios Fountas, Fernando E. Rosas +5
The independent evolution of intelligence in biological and artificial systems offers a unique opportunity to identify its fundamental computational principles. Here we show that l…
On the Identifiability of Regime-Switching Models with Multi-Lag Dependencies
Carles Balsells-Rodas, Toshiko Matsui, Pedro A. M. Mediano +2
Identifiability is central to the interpretability of deep latent variable models, ensuring parameterisations are uniquely determined by the data-generating distribution. However,…
Improved estimators of causal emergence for large systems
Madalina I. Sas, Fernando E. Rosas, Hardik Rajpal +3
A central challenge in the study of complex systems is the quantification of emergence -- understood as the ability of the system to exhibit collective behaviours that cannot be tr…