Inferring couplings in networks across order-disorder phase transitions
arXiv:2106.02349 · doi:10.1103/PhysRevResearch.4.023240
Abstract
Statistical inference is central to many scientific endeavors, yet how it works remains unresolved. Answering this requires a quantitative understanding of the intrinsic interplay between statistical models, inference methods and data structure. To this end, we characterize the efficacy of direct coupling analysis (DCA)--a highly successful method for analyzing amino acid sequence data--in inferring pairwise interactions from samples of ferromagnetic Ising models on random graphs. Our approach allows for physically motivated exploration of qualitatively distinct data regimes separated by phase transitions. We show that inference quality depends strongly on the nature of generative models: optimal accuracy occurs at an intermediate temperature where the detrimental effects from macroscopic order and thermal noise are minimal. Importantly our results indicate that DCA does not always outperform its local-statistics-based predecessors; while DCA excels at low temperatures, it becomes inferior to simple correlation thresholding at virtually all temperatures when data are limited. Our findings offer new insights into the regime in which DCA operates so successfully and more broadly how inference interacts with data structure.
10 pages, 7 figures
References in corpus (31)
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Direct-coupling analysis of residue co-evolution captures native contacts across many protein families
- Emergent complex neural dynamics
- Identification of direct residue contacts in protein-protein interaction by message passing
- Statistical mechanics for natural flocks of birds
- Are biological systems poised at criticality?
- Dynamical synapses causing self-organized criticality in neural networks
- Measuring thermodynamic length
- Ising Model on Networks with an Arbitrary Distribution of Connections
- Maximum entropy models for antibody diversity
- Collective behaviour without collective order in wild swarms of midges
- Inverse statistical problems: from the inverse Ising problem to data science
- Inverse Statistical Physics of Protein Sequences: A Key Issues Review
- Social interactions dominate speed control in driving natural flocks toward criticality
- Finite-size scaling as a way to probe near-criticality in natural swarms
- Coarse--graining, fixed points, and scaling in a large population of neurons
- Statistical physics of pairwise probability models
- Direct-Coupling Analysis of nucleotide coevolution facilitates RNA secondary and tertiary structure prediction
- Morphogenesis at criticality?
- Zipf's law and criticality in multivariate data without fine-tuning
- The simplest maximum entropy model for collective behavior in a neural network
- Information Geometry and Phase Transitions
- Dynamical criticality in the collective activity of a population of retinal neurons
- Adaptive, locally-linear models of complex dynamics
- On the criticality of inferred models
- Searching for collective behavior in a small brain
- Critical fluctuations in proteins native states
- Perspectives on theory at the interface of physics and biology
- Latent dynamical variables produce signatures of spatiotemporal criticality in large biological systems
- Sparse generative modeling via parameter-reduction of Boltzmann machines: application to protein-sequence families
- The behaviour of information flow near criticality