Loop corrections in spin models through density consistency

Abstract

Computing marginal distributions of discrete or semidiscrete Markov random fields (MRFs) is a fundamental, generally intractable problem with a vast number of applications in virtually all fields of science. We present a new family of computational schemes to approximately calculate the marginals of discrete MRFs. This method shares some desirable properties with belief propagation, in particular, providing exact marginals on acyclic graphs, but it differs with the latter in that it includes some loop corrections; i.e., it takes into account correlations coming from all cycles in the factor graph. It is also similar to the adaptive Thouless-Anderson-Palmer method, but it differs with the latter in that the consistency is not on the first two moments of the distribution but rather on the value of its density on a subset of values. The results on finite-dimensional Isinglike models show a significant improvement with respect to the Bethe-Peierls (tree) approximation in all cases and with respect to the plaquette cluster variational method approximation in many cases. In particular, for the critical inverse temperature ${\beta }_c$ of the homogeneous hypercubic lattice, the expansion of ${\left(d{\beta }_c\right)}^{-1}$ around $d=\infty$ of the proposed scheme is exact up to the $d^{-4}$ order, whereas the two latter are exact only up to the $d^{-2}$ order.

arXiv comment12 pages, 3 figures, 1 table

References in corpus (8)

• Loop series for discrete statistical models on graphs
• Cluster Variation Method in Statistical Physics and Probabilistic Graphical Models
• How to Compute Loop Corrections to Bethe Approximation
• Loop expansion around the Bethe-Peierls approximation for lattice models
• Loop expansion around the Bethe approximation through the $M$-layer construction
• On Cavity Approximations for Graphical Models
• Belief propagation with multipoint correlations and its application to Inverse problem
• Gauge-free cluster variational method by maximal messages and moment matching

Cited by in corpus (3)

• Solving Statistical Mechanics on Sparse Graphs with Feedback Set Variational Autoregressive Networks
• Compressed sensing reconstruction using Expectation Propagation
• A Density Consistency approach to the inverse Ising problem