Biases in Inverse Ising Estimates of Near-Critical Behaviour
arXiv:2301.05556 · doi:10.1103/PhysRevE.108.014109
Abstract
Inverse Ising inference allows pairwise interactions of complex binary systems to be reconstructed from empirical correlations. Typical estimators used for this inference, such as Pseudo-likelihood maximization (PLM), are biased. Using the Sherrington-Kirkpatrick (SK) model as a benchmark, we show that these biases are large in critical regimes close to phase boundaries, and may alter the qualitative interpretation of the inferred model. In particular, we show that the small-sample bias causes models inferred through PLM to appear closer-to-criticality than one would expect from the data. Data-driven methods to correct this bias are explored and applied to a functional magnetic resonance imaging (fMRI) dataset from neuroscience. Our results indicate that additional care should be taken when attributing criticality to real-world datasets.
References in corpus (22)
- Statistical mechanics of complex networks
- The structure and function of complex networks
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Identification of direct residue contacts in protein-protein interaction by message passing
- Scale-free correlations in bird flocks
- Optimal Dynamical Range of Excitable Networks at Criticality
- Statistical mechanics for natural flocks of birds
- Are biological systems poised at criticality?
- Colloquium: Criticality and dynamical scaling in living systems
- High-dimensional Ising model selection using -regularized logistic regression
- Spin-Glass Theory for Pedestrians
- Maximum entropy models for antibody diversity
- Searching for collective behavior in a network of real neurons
- Inverse statistical problems: from the inverse Ising problem to data science
- The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
- Inverse Ising inference using all the data
- Statistical physics of pairwise probability models
- On the criticality of inferred models
- Bias in parametric estimation: reduction and useful side-effects
- Pseudolikelihood Decimation Algorithm Improving the Inference of the Interaction Network in a General Class of Ising Models
- Perspectives on theory at the interface of physics and biology
- Finite size corrections in the Sherrington-Kirkpatrick model