Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy Data

Abstract

We introduce a procedure to infer the interactions among a set of binary variables, based on their sampled frequencies and pairwise correlations. The algorithm builds the clusters of variables contributing most to the entropy of the inferred Ising model, and rejects the small contributions due to the sampling noise. Our procedure successfully recovers benchmark Ising models even at criticality and in the low temperature phase, and is applied to neurobiological data.

Accepted for publication in Physical Review Letters (2011)

References in corpus (4)

• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
• Prediction of spatio-temporal patterns of neural activity from pairwise correlations
• Small-correlation expansions for the inverse Ising problem

Cited by in corpus (66)

• Statistical mechanics for natural flocks of birds
• Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models
• Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems
• Searching for collective behavior in a network of real neurons
• Inverse statistical problems: from the inverse Ising problem to data science
• Inverse Statistical Physics of Protein Sequences: A Key Issues Review
• Fast pseudolikelihood maximization for direct-coupling analysis of protein structure from many homologous amino-acid sequences
• Inverse Ising inference using all the data
• Stimulus-dependent maximum entropy models of neural population codes
• Adaptive cluster expansion for the inverse Ising problem: convergence, algorithm and tests
• The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methods
• Pseudolikelihood Decimation Algorithm Improving the Inference of the Interaction Network in a General Class of Ising Models
• Influence of Multiple Sequence Alignment Depth on Potts Statistical Models of Protein Covariation
• Benchmarking inverse statistical approaches for protein structure and design with exactly solvable models
• Mean-field theory for the inverse Ising problem at low temperatures
• On the sufficiency of pairwise interactions in maximum entropy models of biological networks
• Learning and inference in a nonequilibrium Ising model with hidden nodes
• Identification of drug resistance mutations in HIV from constraints on natural evolution
• High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections
• Bethe-Peierls approximation and the inverse Ising model
• Mapping of attention mechanisms to a generalized Potts model
• Large Pseudo-Counts and $L_2$-Norm Penalties Are Necessary for the Mean-Field Inference of Ising and Potts Models
• On the entropy of protein families
• Inference of compressed Potts graphical models
• Dreaming neural networks: rigorous results
• Learning Maximum Entropy Models from finite size datasets: a fast Data-Driven algorithm allows sampling from the posterior distribution
• Universal structural estimator and dynamics approximator for complex networks
• Statistical Physics and Representations in Real and Artificial Neural Networks
• Direct Coupling Analysis of Epistasis in Allosteric Materials
• Inverse spin glass and related maximum entropy problems
• Improving landscape inference by integrating heterogeneous data in the inverse Ising problem
• A tractable method for describing complex couplings between neurons and population rate
• Lattice physics approaches for neural networks
• Detection of cheating by decimation algorithm
• Ensemble Inhibition and Excitation in the Human Cortex: an Ising Model Analysis with Uncertainties
• Adaptive Thouless-Anderson-Palmer approach to inverse Ising problems with quenched random fields
• Inference of the sparse kinetic Ising model using the decimation method
• Optimal regularizations for data generation with probabilistic graphical models
• Towards Parsimonious Generative Modeling of RNA Families
• Inverse Ising problem for one-dimensional chains with arbitrary finite-range couplings
• A statistical physics approach to learning curves for the Inverse Ising problem
• Training Restricted Boltzmann Machines via the Thouless-Anderson-Palmer Free Energy
• Inverse Ising inference with correlated samples
• Regularization and decimation pseudolikelihood approaches to statistical inference in $XY$-spin models
• Sparse model selection in the highly under-sampled regime
• Resummed mean-field inference for strongly coupled data
• L_1-regularized Boltzmann machine learning using majorizer minimization
• Inverse problem for multi-species mean field models in the low temperature phase
• Improved Pseudolikelihood Regularization and Decimation methods on Non-linearly Interacting Systems with Continuous Variables
• Stochastic gradient method with accelerated stochastic dynamics
• Pairwise Ising model analysis of human cortical neuron recordings
• Learning performance in inverse Ising problems with sparse teacher couplings
• Network inference in the non-equilibrium steady state
• Counting solutions from finite samplings
• Thermodynamics of the Ising model encoded in restricted Boltzmann machines
• Beyond inverse Ising model: structure of the analytical solution for a class of inverse problems
• A Density Consistency approach to the inverse Ising problem
• Inverse Ising inference from high-temperature re-weighting of observations
• Ising distribution as a latent variable model
• Active image restoration
• Prediction of Structures and Interactions from Genome Information
• Spectral Bounds for the Ising Ferromagnet on an Arbitrary Given Graph
• Adaptive Cluster Expansion for Ising spin models
• On the trade-off between complexity and correlation decay in structural learning algorithms
• Studying viral populations with tools from quantum spin chains
• Convenient Interface to Inverse Ising (ConIII): A Python 3 Package for Solving Ising-Type Maximum Entropy Models