Pairwise maximum entropy models for studying large biological systems: when they can and when they can't work

Abstract

One of the most critical problems we face in the study of biological systems is building accurate statistical descriptions of them. This problem has been particularly challenging because biological systems typically contain large numbers of interacting elements, which precludes the use of standard brute force approaches. Recently, though, several groups have reported that there may be an alternate strategy. The reports show that reliable statistical models can be built without knowledge of all the interactions in a system; instead, pairwise interactions can suffice. These findings, however, are based on the analysis of small subsystems. Here we ask whether the observations will generalize to systems of realistic size, that is, whether pairwise models will provide reliable descriptions of true biological systems. Our results show that, in most cases, they will not. The reason is that there is a crossover in the predictive power of pairwise models: If the size of the subsystem is below the crossover point, then the results have no predictive power for large systems. If the size is above the crossover point, the results do have predictive power. This work thus provides a general framework for determining the extent to which pairwise models can be used to predict the behavior of whole biological systems. Applied to neural data, the size of most systems studied so far is below the crossover point.

References in corpus (3)

• Weak pairwise correlations imply strongly correlated network states in a neural population
• Small-correlation expansions for the inverse Ising problem
• Multivariate Information Bottleneck

Cited by in corpus (45)

• Searching for collective behavior in a network of real neurons
• Inverse statistical problems: from the inverse Ising problem to data science
• The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
• Measuring multivariate redundant information with pointwise common change in surprisal
• Statistical physics of pairwise probability models
• Energy landscape analysis of neuroimaging data
• Stimulus-dependent maximum entropy models of neural population codes
• Spin glass models for a network of real neurons
• On the criticality of inferred models
• Correlations and functional connections in a population of grid cells
• The Effect of Nonstationarity on Models Inferred from Neural Data
• A discrete time neural network model with spiking neurons II. Dynamics with noise
• On the sufficiency of pairwise interactions in maximum entropy models of biological networks
• Understanding interdependency through complex information sharing
• Maximum entropy models reveal the excitatory and inhibitory correlation structures in cortical neuronal activity
• Network inference using asynchronously updated kinetic Ising Model
• Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
• Statistical modelling of higher-order correlations in pools of neural activity
• Spatio-temporal spike trains analysis for large scale networks using maximum entropy principle and Monte-Carlo method
• Intrinsic limitations of inverse inference in the pairwise Ising spin glass
• Asynchronous Networks and Event Driven Dynamics
• Random versus maximum entropy models of neural population activity
• Inferring Synaptic Structure in presence of Neural Interaction Time Scales
• Dynamics and Performance of Susceptibility Propagation on Synthetic Data
• Effect of coupling asymmetry on mean-field solutions of direct and inverse Sherrington-Kirkpatrick model
• Dynamics and spike trains statistics in conductance-based Integrate-and-Fire neural networks with chemical and electric synapses
• Correlation-Compressed Direct Coupling Analysis
• Ensemble Inhibition and Excitation in the Human Cortex: an Ising Model Analysis with Uncertainties
• Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
• Reconstructing the Hopfield network as an inverse Ising problem
• Role of correlations in population coding
• When are correlations strong?
• Minimum and maximum entropy distributions for binary systems with known means and pairwise correlations
• Entropy-based parametric estimation of spike train statistics
• Maximum Entropy Principle Analysis in Network Systems with Short-time Recordings
• Inferring Higher-Order Couplings with Neural Networks
• Discovering sparse control strategies in C. elegans
• Statistics of spike trains in conductance-based neural networks: Rigorous results
• On the role of non-linear latent features in bipartite generative neural networks
• The Ising decoder: reading out the activity of large neural ensembles
• A generative spike train model with time-structured higher order correlations
• Exponential Reduction in Sample Complexity with Learning of Ising Model Dynamics
• Information Entropy Production of Spatio-Temporal Maximum Entropy Distributions
• A simple mechanism for higher-order correlations in integrate-and-fire neurons
• Digital System Reconstruction by Pairwise Transfer Entropy