Inverse Ising inference from high-temperature re-weighting of observations

Abstract

Maximum Likelihood Estimation (MLE) is the bread and butter of system inference for stochastic systems. In some generality, MLE will converge to the correct model in the infinite data limit. In the context of physical approaches to system inference, such as Boltzmann machines, MLE requires the arduous computation of partition functions summing over all configurations, both observed and unobserved. We present here a conceptually and computationally transparent data-driven approach to system inference that is based on the simple question: How should the Boltzmann weights of observed configurations be modified to make the probability distribution of observed configurations close to a flat distribution? This algorithm gives accurate inference by using only observed configurations for systems with a large number of degrees of freedom where other approaches are intractable.

arXiv comment5 pages, 4 figures

References in corpus (20)

• Weak pairwise correlations imply strongly correlated network states in a neural population
• Identification of direct residue contacts in protein-protein interaction by message passing
• Statistical mechanics for natural flocks of birds
• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• Maximum entropy models for antibody diversity
• Inverse statistical problems: from the inverse Ising problem to data science
• Inverse Statistical Physics of Protein Sequences: A Key Issues Review
• Solving Statistical Mechanics Using Variational Autoregressive Networks
• Inverse Ising inference using all the data
• Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy Data
• Mean Field Theory For Non-Equilibrium Network Reconstruction
• The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methods
• Pseudolikelihood Decimation Algorithm Improving the Inference of the Interaction Network in a General Class of Ising Models
• Mean-field theory for the inverse Ising problem at low temperatures
• U.S. stock market interaction network as learned by the Boltzmann Machine
• Inverse Ising problem in continuous time: A latent variable approach
• Causality inference in stochastic systems from neurons to currencies: Profiting from small sample size
• A statistical physics perspective on criticality in financial markets
• Data-driven inference of hidden nodes in networks
• Resummed mean-field inference for strongly coupled data

Cited by in corpus (2)

• Learning phase transitions from regression uncertainty: A new regression-based machine learning approach for automated detection of phases of matter
• Reveal flocking phase transition of self-propelled active particles by machine learning regression uncertainty