Extrinsic vs Intrinsic Criticality in Systems with Many Components

Abstract

Biological systems with many components often exhibit seemingly critical behaviors, characterized by atypically large correlated fluctuations. Yet the underlying causes remain unclear. Here we define and examine two types of criticality. Intrinsic criticality arises from interactions within the system which are fine-tuned to a critical point. Extrinsic criticality, in contrast, emerges without fine tuning when observable degrees of freedom are coupled to unobserved fluctuating variables. We unify both types of criticality using the language of learning and information theory. We show that critical correlations, intrinsic or extrinsic, lead to diverging mutual information between two halves of the system, and are a feature of learning problems, in which the unobserved fluctuations are inferred from the observable degrees of freedom. We argue that extrinsic criticality is equivalent to standard inference, whereas intrinsic criticality describes fractional learning, in which the amount to be learned depends on the system size. We show further that both types of criticality are on the same continuum, connected by a smooth crossover. In addition, we investigate the observability of Zipf's law, a power-law rank-frequency distribution often used as an empirical signature of criticality. We find that Zipf's law is a robust feature of extrinsic criticality but can be nontrivial to observe for some intrinsically critical systems, including critical mean-field models. We further demonstrate that models with global dynamics, such as oscillatory models, can produce observable Zipf's law without relying on either external fluctuations or fine tuning. Our findings suggest that while possible in theory, fine tuning is not the only, nor the most likely, explanation for the apparent ubiquity of criticality in biological systems with many components.

arXiv comment13 pages, 9 figures

References in corpus (36)

• Holographic Derivation of Entanglement Entropy from AdS/CFT
• Entanglement Entropy and Quantum Field Theory
• Area laws for the entanglement entropy - a review
• Entanglement in quantum critical phenomena
• Geometric and Renormalized Entropy in Conformal Field Theory
• Direct-coupling analysis of residue co-evolution captures native contacts across many protein families
• Emergent complex neural dynamics
• Scale-free correlations in bird flocks
• Statistical mechanics for natural flocks of birds
• Are biological systems poised at criticality?
• Colloquium: Criticality and dynamical scaling in living systems
• Brain organization into resting state networks emerges at criticality on a model of the human connectome
• Entanglement entropy of random quantum critical points in one dimension
• Maximum entropy models for antibody diversity
• Searching for collective behavior in a network of real neurons
• Power-law statistics and universal scaling in the absence of criticality
• Social interactions dominate speed control in driving natural flocks toward criticality
• Finite-size scaling as a way to probe near-criticality in natural swarms
• Coarse--graining, fixed points, and scaling in a large population of neurons
• Epigenetic landscapes explain partially reprogrammed cells and identify key reprogramming genes
• Morphogenesis at criticality?
• Zipf's law and criticality in multivariate data without fine-tuning
• Dynamical criticality in the collective activity of a population of retinal neurons
• Critical and maximally informative encoding between neural populations in the retina
• On sampling and modeling complex systems
• Thermodynamics of natural images
• Finite-temperature mutual information in a simple phase transition
• Complexity Through Nonextensivity
• What do we mean by the dimensionality of behavior?
• Information theoretic aspects of the two-dimensional Ising model
• Statistical Criticality arises in Most Informative Representations
• Latent dynamical variables produce signatures of spatiotemporal criticality in large biological systems
• Quantifying Relevance in Learning and Inference
• Shared information in classical mean-field models
• Predictive information in a nonequilibrium critical model
• Inferring Local Structure from Pairwise Correlations

Cited by in corpus (1)

• Generative random latent features models and statistics of natural images