Resummed mean-field inference for strongly coupled data
arXiv:1510.04005 · doi:10.1103/PhysRevE.94.042118
Abstract
We present a resummed mean-field approximation for inferring the parameters of an Ising or a Potts model from empirical, noisy, one- and two-point correlation functions. Based on a resummation of a class of diagrams of the small correlation expansion of the log-likelihood, the method outperforms standard mean-field inference methods, even when they are regularized. The inference is stable with respect to sampling noise, contrarily to previous works based either on the small correlation expansion, on the Bethe free energy, or on the mean-field and Gaussian models. Because it is mostly analytic, its complexity is still very low, requiring an iterative algorithm to solve for auxiliary variables, that resorts only to matrix inversions and multiplications. We test our algorithm on the Sherrington-Kirkpatrick model submitted to a random external field and large random couplings, and demonstrate that even without regularization, the inference is stable across the whole phase diagram. In addition, the calculation leads to a consistent estimation of the entropy of the data and allows us to sample form the inferred distribution to obtain artificial data that are consistent with the empirical distribution.
arXiv commentv1) 5+6 pages, 3+6 figures; v2) slight changes of the text, typos corrected. v3) Expanded version, 21 pages, 14 figures v4) Published version
References in corpus (37)
- Exact evolution equation for the effective potential
- Direct-coupling analysis of residue co-evolution captures native contacts across many protein families
- Non-Perturbative Renormalization Flow in Quantum Field Theory and Statistical Physics
- Identification of direct residue contacts in protein-protein interaction by message passing
- Statistical mechanics for natural flocks of birds
- Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models
- High-dimensional Ising model selection using -regularized logistic regression
- Market impact and trading profile of large trading orders in stock markets
- The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
- Inverse Ising inference using all the data
- Fast and accurate multivariate Gaussian modeling of protein families: Predicting residue contacts and protein-interaction partners
- Prediction of spatio-temporal patterns of neural activity from pairwise correlations
- Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy Data
- Small-correlation expansions for the inverse Ising problem
- Completeness and consistency of renormalisation group flows
- The simplest maximum entropy model for collective behavior in a neural network
- Mean-Field Equations for Spin Models with Orthogonal Interaction Matrices
- Dynamical criticality in the collective activity of a population of retinal neurons
- Adaptive cluster expansion for the inverse Ising problem: convergence, algorithm and tests
- The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methods
- How to Compute Loop Corrections to Bethe Approximation
- From local to critical fluctuations in lattice models: a non-perturbative renormalization-group approach
- Nonperturbative renormalization-group approach to strongly-correlated lattice bosons
- Benchmarking inverse statistical approaches for protein structure and design with exactly solvable models
- Non-perturbative renormalization-group approach to the Bose-Hubbard model
- Mean-field theory for the inverse Ising problem at low temperatures
- Invariant -Wishart ensembles, crossover densities and asymptotic corrections to the Marchenko-Pastur law
- High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections
- Bethe-Peierls approximation and the inverse Ising model
- Large Pseudo-Counts and -Norm Penalties Are Necessary for the Mean-Field Inference of Ising and Potts Models
- Learning Maximum Entropy Models from finite size datasets: a fast Data-Driven algorithm allows sampling from the posterior distribution
- U.S. stock market interaction network as learned by the Boltzmann Machine
- A Non-Perturbative Renormalization Group approach to quantum XY spin models
- Susceptibility Propagation by Using Diagonal Consistency
- Estimating the principal components of correlation matrices from all their empirical eigenvectors
- A mean field method with correlations determined by linear response
- Adaptive Thouless-Anderson-Palmer approach to inverse Ising problems with quenched random fields
Cited by in corpus (9)
- Inverse statistical problems: from the inverse Ising problem to data science
- High-temperature Expansions and Message Passing Algorithms
- Neural networks with redundant representation: detecting the undetectable
- Expansion of the effective action around non-Gaussian theories
- Inverse Ising inference from high-temperature re-weighting of observations
- Recursive algorithm for generating high-temperature expansions for spin systems and the chiral non-linear susceptibility
- Diagrammatics for the Inverse Problem in Spin Systems and Simple Liquids
- Functional renormalization group for signal detection and stochastic ergodicity breaking
- Diagrammatics of free energies with fixed variance for high-dimensional data