Mean Field Theory For Non-Equilibrium Network Reconstruction

Abstract

There has been recent progress on the problem of inferring the structure of interactions in complex networks when they are in stationary states satisfying detailed balance, but little has been done for non-equilibrium systems. Here we introduce an approach to this problem, considering, as an example, the question of recovering the interactions in an asymmetrically-coupled, synchronously-updated Sherrington-Kirkpatrick model. We derive an exact iterative inversion algorithm and develop efficient approximations based on dynamical mean-field and Thouless-Anderson-Palmer equations that express the interactions in terms of equal-time and one time step-delayed correlation functions.

new version, accepted in PRL. For the Supp. Mat. (ref. 11), please contact the authors

References in corpus (6)

• Weak pairwise correlations imply strongly correlated network states in a neural population
• Identification of direct residue contacts in protein-protein interaction by message passing
• High-dimensional Ising model selection using ${\ell }_1$-regularized logistic regression
• The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
• Prediction of spatio-temporal patterns of neural activity from pairwise correlations
• Dynamical TAP approach to mean field glassy systems

Cited by in corpus (71)

• Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems
• Inverse statistical problems: from the inverse Ising problem to data science
• Stimulus-dependent maximum entropy models of neural population codes
• Network reconstruction from random phase-resetting
• Scalability of asynchronous networks is limited by one-to-one mapping between effective connectivity and correlations
• Path integral methods for the dynamics of stochastic and disordered systems
• Dynamical maximum entropy approach to flocking
• Correlations and functional connections in a population of grid cells
• The Effect of Nonstationarity on Models Inferred from Neural Data
• Dynamical TAP equations for non-equilibrium Ising spin glasses
• Maximum likelihood reconstruction for Ising models with asynchronous updates
• Learning and inference in a nonequilibrium Ising model with hidden nodes
• Network inference using asynchronously updated kinetic Ising Model
• A unifying framework for mean-field theories of asymmetric kinetic Ising systems
• Short-range interaction vs long-range correlation in bird flocks
• Dynamic mean-field and cavity methods for diluted Ising systems
• Gibbs distribution analysis of temporal correlations structure in retina ganglion cells
• Region graph partition function expansion and approximate free energy landscapes: Theory and some numerical results
• Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
• Tackling the subsampling problem to infer collective properties from limited data
• A message-passing scheme for non-equilibrium stationary states
• Inference of kinetic Ising model on sparse graphs
• Universal structural estimator and dynamics approximator for complex networks
• U.S. stock market interaction network as learned by the Boltzmann Machine
• Spatio-temporal spike trains analysis for large scale networks using maximum entropy principle and Monte-Carlo method
• Learning with hidden variables
• Network Inference with Hidden Units
• Inverse Ising problem in continuous time: A latent variable approach
• Inferring Synaptic Structure in presence of Neural Interaction Time Scales
• Belief-Propagation and replicas for inference and learning in a kinetic Ising model with hidden spins
• Inferring hidden states in a random kinetic Ising model: replica analysis
• Inference and learning in sparse systems with multiple states
• Causality inference in stochastic systems from neurons to currencies: Profiting from small sample size
• Effect of coupling asymmetry on mean-field solutions of direct and inverse Sherrington-Kirkpatrick model
• Generalized mean field approximation for parallel dynamics of the Ising model
• Data-driven inference of hidden nodes in networks
• Inference of the sparse kinetic Ising model using the decimation method
• Using persistent homology to reveal hidden information in neural data
• Pairwise maximum-entropy models and their Glauber dynamics: bimodality, bistability, non-ergodicity problems, and their elimination via inhibition
• Turing-like patterns in an asymmetric dynamic Ising model
• Modeling the correlated activity of neural populations: A review
• Inferring hidden states in Langevin dynamics on large networks: Average case performance
• Variational perturbation and extended Plefka approaches to dynamics on random networks: the case of the kinetic Ising model
• Revealing directed effective connectivity of cortical neuronal networks from measurements
• Dynamics of asymmetric kinetic Ising systems revisited
• Derivative-variable correlation reveals the structure of dynamical networks
• Sparse model selection in the highly under-sampled regime
• Learning of couplings for random asymmetric kinetic Ising models revisited: random correlation matrices and learning curves
• The appropriateness of ignorance in the inverse kinetic Ising model
• Matrix Product Belief Propagation for reweighted stochastic dynamics over graphs
• Financial interaction networks inferred from traded volumes
• On the equivalence between the Kinetic Ising Model and discrete autoregressive processes
• Entropy-based parametric estimation of spike train statistics
• From statistical inference to a differential learning rule for stochastic neural networks
• Learning performance in inverse Ising problems with sparse teacher couplings
• Network inference in the non-equilibrium steady state
• Decoupling approximation robustly reconstructs directed dynamical networks
• Beyond inverse Ising model: structure of the analytical solution for a class of inverse problems
• Nonequilibrium dynamics of the Ising model on heterogeneous networks with an arbitrary distribution of threshold noise
• Inference of stochastic time series with missing data
• Inverse Ising inference from high-temperature re-weighting of observations
• State-space kinetic Ising model reveals task-dependent entropy flow in sparsely active nonequilibrium neuronal dynamics
• Far-from-equilibrium complex landscapes
• Inferring the parameters of a Markov process from snapshots of the steady state
• Statistics of spike trains in conductance-based neural networks: Rigorous results
• Exponential Reduction in Sample Complexity with Learning of Ising Model Dynamics
• Objective and efficient inference for couplings in neuronal networks
• Generalization of generative model for neuronal ensemble inference method
• Data quality for the inverse Ising problem
• On the complexity of logistic regression models
• Information Entropy Production of Spatio-Temporal Maximum Entropy Distributions