The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity

Abstract

We study pairwise Ising models for describing the statistics of multi-neuron spike trains, using data from a simulated cortical network. We explore efficient ways of finding the optimal couplings in these models and examine their statistical properties. To do this, we extract the optimal couplings for subsets of size up to 200 neurons, essentially exactly, using Boltzmann learning. We then study the quality of several approximate methods for finding the couplings by comparing their results with those found from Boltzmann learning. Two of these methods- inversion of the TAP equations and an approximation proposed by Sessak and Monasson- are remarkably accurate. Using these approximations for larger subsets of neurons, we find that extracting couplings using data from a subset smaller than the full network tends systematically to overestimate their magnitude. This effect is described qualitatively by infinite-range spin glass theory for the normal phase. We also show that a globally-correlated input to the neurons in the network lead to a small increase in the average coupling. However, the pair-to-pair variation of the couplings is much larger than this and reflects intrinsic properties of the network. Finally, we study the quality of these models by comparing their entropies with that of the data. We find that they perform well for small subsets of the neurons in the network, but the fit quality starts to deteriorate as the subset size grows, signalling the need to include higher order correlations to describe the statistics of large networks.

12 pages, 10 figures

References in corpus (3)

• Weak pairwise correlations imply strongly correlated network states in a neural population
• Pairwise maximum entropy models for studying large biological systems: when they can and when they can't work
• Small-correlation expansions for the inverse Ising problem

Cited by in corpus (81)

• Searching for collective behavior in a network of real neurons
• Inverse statistical problems: from the inverse Ising problem to data science
• Inverse Statistical Physics of Protein Sequences: A Key Issues Review
• Unsupervised Generative Modeling Using Matrix Product States
• Solving Statistical Mechanics Using Variational Autoregressive Networks
• Adaptive Cluster Expansion for Inferring Boltzmann Machines with Noisy Data
• Energy landscape analysis of neuroimaging data
• Statistical physics of pairwise probability models
• Mean Field Theory For Non-Equilibrium Network Reconstruction
• Stimulus-dependent maximum entropy models of neural population codes
• The Bethe approximation for solving the inverse Ising problem: a comparison with other inference methods
• Spin glass models for a network of real neurons
• On the criticality of inferred models
• The Effect of Nonstationarity on Models Inferred from Neural Data
• Dynamical TAP equations for non-equilibrium Ising spin glasses
• Maximum likelihood reconstruction for Ising models with asynchronous updates
• Market structure explained by pairwise interactions
• High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections
• Network inference using asynchronously updated kinetic Ising Model
• A unifying framework for mean-field theories of asymmetric kinetic Ising systems
• Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
• Inference of kinetic Ising model on sparse graphs
• U.S. stock market interaction network as learned by the Boltzmann Machine
• Spatio-temporal spike trains analysis for large scale networks using maximum entropy principle and Monte-Carlo method
• Intrinsic limitations of inverse inference in the pairwise Ising spin glass
• Network Inference with Hidden Units
• Memory-free dynamics for the TAP equations of Ising models with arbitrary rotation invariant ensembles of random coupling matrices
• Inverse Ising problem in continuous time: A latent variable approach
• Improving landscape inference by integrating heterogeneous data in the inverse Ising problem
• Inverse problem robustness for multi-species mean field spin models
• Aligning biological sequences by exploiting residue conservation and coevolution
• Inferring Synaptic Structure in presence of Neural Interaction Time Scales
• Solving the inverse Ising problem by mean-field methods in a clustered phase space with many states
• Belief-Propagation and replicas for inference and learning in a kinetic Ising model with hidden spins
• Statistical pairwise interaction model of stock market
• Dynamics and Performance of Susceptibility Propagation on Synthetic Data
• Ensemble Inhibition and Excitation in the Human Cortex: an Ising Model Analysis with Uncertainties
• Dynamics and spike trains statistics in conductance-based Integrate-and-Fire neural networks with chemical and electric synapses
• Effects of hidden nodes on network structure inference
• Adaptive Thouless-Anderson-Palmer approach to inverse Ising problems with quenched random fields
• Generalized mean field approximation for parallel dynamics of the Ising model
• Robustness of functional networks at criticality against structural defects
• Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
• Reconstructing the Hopfield network as an inverse Ising problem
• Aggregation models on hypergraphs
• Inverse Ising problem for one-dimensional chains with arbitrary finite-range couplings
• A statistical physics approach to learning curves for the Inverse Ising problem
• Role of correlations in population coding
• Regularization and decimation pseudolikelihood approaches to statistical inference in $XY$-spin models
• Sparse model selection in the highly under-sampled regime
• Resummed mean-field inference for strongly coupled data
• The appropriateness of ignorance in the inverse kinetic Ising model
• Expansion of the effective action around non-Gaussian theories
• Optimal Region of Latching Activity in an Adaptive Potts Model for Networks of Neurons
• Improved Pseudolikelihood Regularization and Decimation methods on Non-linearly Interacting Systems with Continuous Variables
• Entropy-based parametric estimation of spike train statistics
• Inverse problem for multi-species mean field models in the low temperature phase
• Optimized brute-force algorithms for the bifurcation analysis of a spin-glass-like neural network model
• Biases in Inverse Ising Estimates of Near-Critical Behaviour
• Perturbative large deviation analysis of non-equilibrium dynamics
• Counting solutions from finite samplings
• Maximum Entropy Principle Analysis in Network Systems with Short-time Recordings
• Inverse problem for the mean-field monomer-dimer model with attractive interaction
• Message passing algorithms for the Hopfield network reconstruction: threshold behavior and limitation
• Granger causality and the inverse Ising problem
• Correspondence between temporal correlations in time series, inverse problems, and the Spherical Model
• A Density Consistency approach to the inverse Ising problem
• Ising distribution as a latent variable model
• A mean field model for the collective behaviour of interacting multi-species particles. Mathematical results and application to the inverse problem
• Reconstruction of Pairwise Interactions using Energy-Based Models
• On the typical properties of inverse problems in statistical mechanics
• Pairwise interactions origin of entropy functions
• Worldwide bilateral geopolitical interactions network inferred from national disciplinary profiles
• Inverse problems in spin models
• Exponential Reduction in Sample Complexity with Learning of Ising Model Dynamics
• Objective and efficient inference for couplings in neuronal networks
• The Ising decoder: reading out the activity of large neural ensembles
• Data quality for the inverse Ising problem
• Modeling Language Evolution Using a Spin Glass Approach
• Density-based clustering: A 'landscape view' of multi-channel neural data for inference and dynamic complexity analysis
• Mixed phases in feedback Ising models