Pseudolikelihood Decimation Algorithm Improving the Inference of the Interaction Network in a General Class of Ising Models

Abstract

In this Letter we propose a new method to infer the topology of the interaction network in pairwise models with Ising variables. By using the pseudolikelihood method (PLM) at high temperature, it is generally possible to distinguish between zero and nonzero couplings because a clear gap separate the two groups. However at lower temperatures the PLM is much less effective and the result depends on subjective choices, such as the value of the ${\ell }_1$ regularizer and that of the threshold to separate nonzero couplings from null ones. We introduce a decimation procedure based on the PLM that recursively sets to zero the less significant couplings, until the variation of the pseudolikelihood signals that relevant couplings are being removed. The new method is fully automated and does not require any subjective choice by the user. Numerical tests have been performed on a wide class of Ising models, having different topologies (from random graphs to finite dimensional lattices) and different couplings (both diluted ferromagnets in a field and spin glasses). These numerical results show that the new algorithm performs better than standard PLM

5 pages, 4 figures

References in corpus (5)

• Identification of direct residue contacts in protein-protein interaction by message passing
• Improved contact prediction in proteins: Using pseudolikelihoods to infer Potts models
• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• Mean-field theory for the inverse Ising problem at low temperatures
• A mean field method with correlations determined by linear response

Cited by in corpus (47)

• Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems
• Inverse statistical problems: from the inverse Ising problem to data science
• Inverse Statistical Physics of Protein Sequences: A Key Issues Review
• Network reconstruction and community detection from dynamics
• Sparse modeling approach to analytical continuation of imaginary-time quantum Monte Carlo data
• Improving contact prediction along three dimensions
• Sparse Modeling in Quantum Many-Body Problems
• Sparse generative modeling via parameter-reduction of Boltzmann machines: application to protein-sequence families
• Universal structural estimator and dynamics approximator for complex networks
• Introduction to correlation networks: Interdisciplinary approaches beyond thresholding
• Inverse spin glass and related maximum entropy problems
• Improving landscape inference by integrating heterogeneous data in the inverse Ising problem
• Higher-order interactions in statistical physics and machine learning: A model-independent solution to the inverse problem at equilibrium
• Aligning biological sequences by exploiting residue conservation and coevolution
• SpM: Sparse modeling tool for analytic continuation of imaginary-time Green's function
• Solving the inverse Ising problem by mean-field methods in a clustered phase space with many states
• Inverse design of disordered stealthy hyperuniform spin chains
• Detection of cheating by decimation algorithm
• Causality inference in stochastic systems from neurons to currencies: Profiting from small sample size
• Inference of the sparse kinetic Ising model using the decimation method
• Generalized hetero-associative neural networks
• A statistical physics approach to learning curves for the Inverse Ising problem
• Sparse model selection in the highly under-sampled regime
• Network reconstruction via the minimum description length principle
• Parallel Learning by Multitasking Neural Networks
• Regularization and decimation pseudolikelihood approaches to statistical inference in $XY$-spin models
• Statistical-mechanical analysis of pre-training and fine tuning in deep learning
• L_1-regularized Boltzmann machine learning using majorizer minimization
• Stochastic gradient method with accelerated stochastic dynamics
• Improved Pseudolikelihood Regularization and Decimation methods on Non-linearly Interacting Systems with Continuous Variables
• Learning performance in inverse Ising problems with sparse teacher couplings
• Biases in Inverse Ising Estimates of Near-Critical Behaviour
• Inference of stochastic time series with missing data
• Inverse problem for multi-body interaction of nonlinear waves
• Inverse Ising inference from high-temperature re-weighting of observations
• Cycle-based Cluster Variational Method for Direct and Inverse Inference
• Active image restoration
• Reconstruction of Pairwise Interactions using Energy-Based Models
• Learning Direct and Inverse Transmission Matrices
• On the role of non-linear latent features in bipartite generative neural networks
• Structure Learning in Inverse Ising Problems Using ${\ell }_2$-Regularized Linear Estimator
• On Model Selection Consistency of Lasso for High-Dimensional Ising Models
• Worldwide bilateral geopolitical interactions network inferred from national disciplinary profiles
• Ising Model Selection Using ${\ell }_1$-Regularized Linear Regression: A Statistical Mechanics Analysis
• Data quality for the inverse Ising problem
• On the complexity of logistic regression models
• Searching for feasible stationary states in reaction networks by solving a Boolean constraint satisfaction problem