Correlated fluctuations in strongly-coupled binary networks beyond equilibrium
arXiv:1512.01073 · doi:10.1103/PhysRevX.6.031024
Abstract
Randomly coupled Ising spins constitute the classical model of collective phenomena in disordered systems, with applications covering ferromagnetism, combinatorial optimization, protein folding, stock market dynamics, and social dynamics. The phase diagram of these systems is obtained in the thermodynamic limit by averaging over the quenched randomness of the couplings. However, many applications require the statistics of activity for a single realization of the possibly asymmetric couplings in finite-sized networks. Examples include reconstruction of couplings from the observed dynamics, learning in the central nervous system by correlation-sensitive synaptic plasticity, and representation of probability distributions for sampling-based inference. The systematic cumulant expansion for kinetic binary (Ising) threshold units with strong, random and asymmetric couplings presented here goes beyond mean-field theory and is applicable outside thermodynamic equilibrium; a system of approximate non-linear equations predicts average activities and pairwise covariances in quantitative agreement with full simulations down to hundreds of units. The linearized theory yields an expansion of the correlation- and response functions in collective eigenmodes, leads to an efficient algorithm solving the inverse problem, and shows that correlations are invariant under scaling of the interaction strengths.
References in corpus (27)
- Statistical physics of social dynamics
- Stochastic thermodynamics, fluctuation theorems, and molecular machines
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Analytical Solution of the Off-Equilibrium Dynamics of a Long Range Spin-Glass Model
- Epidemic dynamics on an adaptive network
- Maximum entropy models for antibody diversity
- Is the Voter Model a model for voters?
- High-accuracy approximation of binary-state dynamics on networks
- Decorrelation of neural-network activity by inhibitory feedback
- Binary-state dynamics on complex networks: pair approximation and beyond
- Transition to chaos in random neuronal networks
- Transition to chaos in random networks with cell-type-specific connectivity
- Statistical physics of pairwise probability models
- The correlation structure of local cortical networks intrinsically results from recurrent dynamics
- Scalability of asynchronous networks is limited by one-to-one mapping between effective connectivity and correlations
- A unified view on weakly correlated recurrent networks
- Extensive load in multitasking associative networks
- Correlations, fluctuations and stability of a finite-size network of coupled oscillators
- A Kinetic Theory of Coupled Oscillators
- Heterogeneous connections induce oscillations in large scale networks
- High-Dimensional Inference with the generalized Hopfield Model: Principal Component Analysis and Corrections
- Network inference using asynchronously updated kinetic Ising Model
- Mean-field theory for a spin-glass model of neural networks: TAP free energy and paramagnetic to spin-glass transition
- Dynamical Replica Theory for Disordered Spin Systems
- A three-threshold learning rule approaches the maximal capacity of recurrent neural networks
- Memory Recall and Spike Frequency Adaptation
- Physics and Financial Economics (1776-2014): Puzzles, Ising and Agent-Based models
Cited by in corpus (13)
- How strong are correlations in strongly recurrent neuronal networks?
- Machine Learning Link Inference of Noisy Delay-coupled Networks with Opto-Electronic Experimental Tests
- Integration of continuous-time dynamics in a spiking neural network simulator
- Deterministic networks for probabilistic computing
- A complete mean-field theory for dynamics of binary recurrent neural networks
- Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
- Self-consistent formulations for stochastic nonlinear neuronal dynamics
- Revealing directed effective connectivity of cortical neuronal networks from measurements
- Transition to Reconstructibility in Weakly Coupled Networks
- Self-organization of nonlinearly coupled neural fluctuations into synergistic population codes
- Effect of Synaptic Heterogeneity on Neuronal Coordination
- Finite size effects for spiking neural networks with spatially dependent coupling
- Spontaneous and stimulus-induced coherent states of critically balanced neuronal networks