The simplest maximum entropy model for collective behavior in a neural network
arXiv:1207.6319 · doi:10.1088/1742-5468/2013/03/P03011
Abstract
Recent work emphasizes that the maximum entropy principle provides a bridge between statistical mechanics models for collective behavior in neural networks and experiments on networks of real neurons. Most of this work has focused on capturing the measured correlations among pairs of neurons. Here we suggest an alternative, constructing models that are consistent with the distribution of global network activity, i.e. the probability that K out of N cells in the network generate action potentials in the same small time bin. The inverse problem that we need to solve in constructing the model is analytically tractable, and provides a natural "thermodynamics" for the network in the limit of large N. We analyze the responses of neurons in a small patch of the retina to naturalistic stimuli, and find that the implied thermodynamics is very close to an unusual critical point, in which the entropy (in proper units) is exactly equal to the energy.
References in corpus (7)
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Flocks, herds, and schools: A quantitative theory of flocking
- Identification of direct residue contacts in protein-protein interaction by message passing
- Statistical mechanics for natural flocks of birds
- Are biological systems poised at criticality?
- Maximum entropy models for antibody diversity
- Toward a statistical mechanics of four letter words
Cited by in corpus (37)
- Colloquium: Criticality and dynamical scaling in living systems
- Searching for collective behavior in a network of real neurons
- Inverse statistical problems: from the inverse Ising problem to data science
- Social interactions dominate speed control in driving natural flocks toward criticality
- Collective behavior of place and non-place neurons in the hippocampal network
- Zipf's law and criticality in multivariate data without fine-tuning
- Dynamical criticality in the collective activity of a population of retinal neurons
- Perspectives on theory at the interface of physics and biology
- Signatures of criticality arise in simple neural population models with correlations
- Short-range interaction vs long-range correlation in bird flocks
- Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
- Exact computation of the Maximum Entropy Potential of spiking neural networks models
- Parameters estimation for spatio-temporal maximum entropy distributions: application to neural spike trains
- Separating intrinsic interactions from extrinsic correlations in a network of sensory neurons
- Beyond the French Flag Model: Exploiting Spatial and Gene Regulatory Interactions for Positional Information
- Inverse spin glass and related maximum entropy problems
- Ensemble Inhibition and Excitation in the Human Cortex: an Ising Model Analysis with Uncertainties
- Conditional Finite Mixtures of Poisson Distributions for Context-Dependent Neural Correlations
- Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
- Neural activity in quarks language: Lattice Field Theory for a network of real neurons
- Modeling the correlated activity of neural populations: A review
- Inferring Cultural Landscapes with the Inverse Ising Model
- Resummed mean-field inference for strongly coupled data
- Inferring couplings in networks across order-disorder phase transitions
- Epistemic Phase Transitions in Mathematical Proofs
- Nonlinear Stochastic Dynamics of Complex Systems, II: Potential of Entropic Force in Markov Systems with Nonequilibrium Steady State, Generalized Gibbs Function and Criticality
- On Maximum Entropy and Inference
- Minimum and maximum entropy distributions for binary systems with known means and pairwise correlations
- Large Deviations Properties of Maximum Entropy Markov Chains from Spike Trains
- Explosive neural networks via higher-order interactions in curved statistical manifolds
- Pattern recognition at different scales: a statistical perspective
- Theory of population coupling and applications to describe high order correlations in large populations of interacting neurons
- Thermodynamic Formalism in Neuronal Dynamics and Spike Train Statistics
- Universal scaling relation and criticality in metabolism and growth of Escherichia coli
- Discovering sparse control strategies in C. elegans
- Matrix approach to generalized ensemble theory for nonequilibrium discrete systems
- Ultrametric identities in glassy models of Natural Evolution