Ising distribution as a latent variable model
arXiv:1803.02598 · doi:10.1103/PhysRevE.99.042147
Abstract
During the past decades, the Ising distribution has attracted interest in many applied disciplines, as the maximum entropy distribution associated to any set of correlated binary (`spin') variables with observed means and covariances. However, numerically speaking, the Ising distribution is unpractical, so alternative models are often preferred to handle correlated binary data. One popular alternative, especially in life sciences, is the Cox distribution (or the closely related dichotomized Gaussian distribution and log-normal Cox point process), where the spins are generated independently conditioned on the drawing of a latent variable with a multivariate normal distribution. This article explores the conditions for a principled replacement of the Ising distribution by a Cox distribution. It shows that the Ising distribution itself can be treated as a latent variable model, and it explores when this latent variable has a quasi-normal distribution. A variational approach to this question reveals a formal link with classic mean-field methods, especially Opper and Winther's adaptive TAP approximation. This link is confirmed by weak coupling (Plefka) expansions of the different approximations and then by numerical tests. Overall, this study suggests that an Ising distribution can be replaced by a Cox distribution in practical applications, precisely when its parameters lie in the `mean-field domain'.
arXiv comment19 pages, 7 figures
References in corpus (13)
- An efficient, multiple range random walk algorithm to calculate the density of states
- Exchange Monte Carlo Method and Application to Spin Glass Simulations
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Identification of direct residue contacts in protein-protein interaction by message passing
- The Bethe lattice spin glass revisited
- Spatial and Spatio-Temporal Log-Gaussian Cox Processes: Extending the Geostatistical Paradigm
- The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
- Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy Data
- Small-correlation expansions for the inverse Ising problem
- Tractable approximations for probabilistic models: The adaptive TAP mean field approach
- The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methods
- Mean-field theory for a spin-glass model of neural networks: TAP free energy and paramagnetic to spin-glass transition
- Solving the inverse Ising problem by mean-field methods in a clustered phase space with many states