An Exact Theory of Causal Emergence for Linear Stochastic Iteration Systems

Abstract

After coarse-graining a complex system, the dynamics of its macro-state may exhibit more pronounced causal effects than those of its micro-state. This phenomenon, known as causal emergence, is quantified by the indicator of effective information. However, two challenges confront this theory: the absence of well-developed frameworks in continuous stochastic dynamical systems and the reliance on coarse-graining methodologies. In this study, we introduce an exact theoretic framework for causal emergence within linear stochastic iteration systems featuring continuous state spaces and Gaussian noise. Building upon this foundation, we derive an analytical expression for effective information across general dynamics and identify optimal linear coarse-graining strategies that maximize the degree of causal emergence when the dimension averaged uncertainty eliminated by coarse-graining has an upper bound. Our investigation reveals that the maximal causal emergence and the optimal coarse-graining methods are primarily determined by the principal eigenvalues and eigenvectors of the dynamic system's parameter matrix, with the latter not being unique. To validate our propositions, we apply our analytical models to three simplified physical systems, comparing the outcomes with numerical simulations, and consistently achieve congruent results.

References in corpus (12)

• Granger causality and transfer entropy are equivalent for Gaussian variables
• The Moore-Penrose Pseudoinverse. A Tutorial Review of the Theory
• Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate data
• When the map is better than the territory
• Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimation
• Mutual Information as a Tool for Identifying Phase Transitions in Dynamical Complex Systems With Limited Data
• Understanding the mesoscopic scaling patterns within cities
• Expectation-Maximizing Network Reconstruction and MostApplicable Network Types Based on Binary Time Series Data
• Machine Learning Holographic Mapping by Neural Network Renormalization Group
• Neural Information Squeezer for Causal Emergence
• Causal Geometry
• Gaussian Partial Information Decomposition: Bias Correction and Application to High-dimensional Data

Cited by in corpus (1)

• SVD-based Causal Emergence for Gaussian Iterative Systems