Searching for collective behavior in a network of real neurons

Abstract

Maximum entropy models are the least structured probability distributions that exactly reproduce a chosen set of statistics measured in an interacting network. Here we use this principle to construct probabilistic models which describe the correlated spiking activity of populations of up to 120 neurons in the salamander retina as it responds to natural movies. Already in groups as small as 10 neurons, interactions between spikes can no longer be regarded as small perturbations in an otherwise independent system; for 40 or more neurons pairwise interactions need to be supplemented by a global interaction that controls the distribution of synchrony in the population. Here we show that such "K-pairwise" models--being systematic extensions of the previously used pairwise Ising models--provide an excellent account of the data. We explore the properties of the neural vocabulary by: 1) estimating its entropy, which constrains the population's capacity to represent visual information; 2) classifying activity patterns into a small set of metastable collective modes; 3) showing that the neural codeword ensembles are extremely inhomogenous; 4) demonstrating that the state of individual neurons is highly predictable from the rest of the population, allowing the capacity for error correction.

24 pages, 19 figures

References in corpus (9)

• Identification of direct residue contacts in protein-protein interaction by message passing
• The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
• Prediction of spatio-temporal patterns of neural activity from pairwise correlations
• Small-correlation expansions for the inverse Ising problem
• Ising models for networks of real neurons
• Faster solutions of the inverse pairwise Ising problem
• Rediscovering the power of pairwise interactions
• Higher Order Correlations within Cortical Layers Dominate Functional Connectivity in Microcolumns
• When are correlations strong?

Cited by in corpus (81)

• Colloquium: Criticality and dynamical scaling in living systems
• Inverse statistical problems: from the inverse Ising problem to data science
• Social interactions dominate speed control in driving natural flocks toward criticality
• Collective behavior of place and non-place neurons in the hippocampal network
• Distributions of covariances as a window into the operational regime of neuronal networks
• Two types of criticality in the brain
• Resolving coiled shapes reveals new reorientation behaviors in C. elegans
• PCA meets RG
• Searching for collective behavior in a small brain
• Statistical mechanics of the US Supreme Court
• What do we mean by the dimensionality of behavior?
• Statistical mechanics for metabolic networks during steady-state growth
• Perspectives on theory at the interface of physics and biology
• Signatures of criticality arise in simple neural population models with correlations
• On the sufficiency of pairwise interactions in maximum entropy models of biological networks
• Topological Information Data Analysis
• Maximum entropy models reveal the excitatory and inhibitory correlation structures in cortical neuronal activity
• Predicting Gibbs-State Expectation Values with Pure Thermal Shadows
• Short-range interaction vs long-range correlation in bird flocks
• Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
• Strong and weak principles of neural dimension reduction
• Tackling the subsampling problem to infer collective properties from limited data
• On the Sample Complexity of Quantum Boltzmann Machine Learning
• Learning Maximum Entropy Models from finite size datasets: a fast Data-Driven algorithm allows sampling from the posterior distribution
• Separating intrinsic interactions from extrinsic correlations in a network of sensory neurons
• Synthesizing realistic neural population activity patterns using Generative Adversarial Networks
• Random versus maximum entropy models of neural population activity
• A tractable method for describing complex couplings between neurons and population rate
• A general approximation for the dynamics of quantitative traits
• Blindfold learning of an accurate neural metric
• Surges of collective human activity emerge from simple pairwise correlations
• Lattice physics approaches for neural networks
• Causality inference in stochastic systems from neurons to currencies: Profiting from small sample size
• Field theoretical approach for signal detection in nearly continuous positive spectra II: Tensorial data
• Ensemble Inhibition and Excitation in the Human Cortex: an Ising Model Analysis with Uncertainties
• Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
• Data-driven inference of hidden nodes in networks
• Self-consistent formulations for stochastic nonlinear neuronal dynamics
• Inference of the sparse kinetic Ising model using the decimation method
• Inferring effective couplings with Restricted Boltzmann Machines
• Effects of hidden nodes on network structure inference
• The Structured `Low Temperature' Phase of the Retinal Population Code
• Modeling the correlated activity of neural populations: A review
• Signal detection in nearly continuous spectra and symmetry breaking
• Field theoretical approach for signal detection in nearly continuous positive spectra I: Matricial data
• Clustering of neural codewords revealed by a first-order phase transition
• Neurons as an Information-theoretic Engine
• Inferring a network from dynamical signals at its nodes
• Expansion of the effective action around non-Gaussian theories
• Training Quantum Boltzmann Machines with the $\beta$-Variational Quantum Eigensolver
• Large Deviations Properties of Maximum Entropy Markov Chains from Spike Trains
• Learning performance in inverse Ising problems with sparse teacher couplings
• Biases in Inverse Ising Estimates of Near-Critical Behaviour
• Explosive neural networks via higher-order interactions in curved statistical manifolds
• Time Evolution of Entropy in a Growth model: Dependence on the Description
• Pairwise Ising model analysis of human cortical neuron recordings
• Inference of stochastic time series with missing data
• Maximum Entropy Principle Analysis in Network Systems with Short-time Recordings
• Higher-Order Interactions and Their Duals Reveal Synergy and Logical Dependence beyond Shannon-Information
• Coarse--graining and hints of scaling in a population of 1000+ neurons
• Theory of population coupling and applications to describe high order correlations in large populations of interacting neurons
• The statistical mechanics of Twitter
• Well posedness and Maximum Entropy Approximation for the Dynamics of Quantitative Traits
• Thermodynamic Formalism in Neuronal Dynamics and Spike Train Statistics
• Semiparametric energy-based probabilistic models
• Extrinsic vs Intrinsic Criticality in Systems with Many Components
• Discovering sparse control strategies in C. elegans
• The dual of the space of interactions in neural network models
• Reconstruction of Pairwise Interactions using Energy-Based Models
• Pairwise interactions origin of entropy functions
• Exploring a strongly non-Markovian animal behavior
• Noise-Robust Modes of the Retinal Population Code have the Geometry of "Ridges" and Correspond with Neuronal Communities
• Impact of triplet correlations on neural population codes
• Sequential noise-induced escapes for oscillatory network dynamics
• Inference in neural networks using conditional mean-field methods
• State-space analysis of an Ising model reveals contributions of pairwise interactions to sparseness, fluctuation, and stimulus coding of monkey V1 neurons
• Signal Processing in the Retina: Interpretable Graph Classifier to Predict Ganglion Cell Responses
• Information Entropy Production of Spatio-Temporal Maximum Entropy Distributions
• Developing a Maximum-Entropy Restricted Boltzmann Machine with a Quantum Thermodynamics Formalism
• Mapping Inter-City Trade Networks to Maximum Entropy Models using Electronic Invoice Data
• The Poincaré-Boltzmann Machine: from Statistical Physics to Machine Learning and back