Inferring hidden states in Langevin dynamics on large networks: Average case performance

Abstract

We present average performance results for dynamical inference problems in large networks, where a set of nodes is hidden while the time trajectories of the others are observed. Examples of this scenario can occur in signal transduction and gene regulation networks. We focus on the linear stochastic dynamics of continuous variables interacting via random Gaussian couplings of generic symmetry. We analyze the inference error, given by the variance of the posterior distribution over hidden paths, in the thermodynamic limit and as a function of the system parameters and the ratio α between the number of hidden and observed nodes. By applying Kalman filter recursions we find that the posterior dynamics is governed by an "effective" drift that incorporates the effect of the observations. We present two approaches for characterizing the posterior variance that allow us to tackle, respectively, equilibrium and nonequilibrium dynamics. The first appeals to Random Matrix Theory and reveals average spectral properties of the inference error and typical posterior relaxation times, the second is based on dynamical functionals and yields the inference error as the solution of an algebraic equation.

arXiv comment20 pages, 5 figures

References in corpus (16)

• Spectral Statistics of Erd{\H o}s-Rényi Graphs II: Eigenvalue Spacing and the Extreme Eigenvalues
• Bayesian inference of epidemics on networks via Belief Propagation
• Perturbation Biology: inferring signaling networks in cellular systems
• Spectral statistics of Erdős-Rényi graphs I: Local semicircle law
• Cavity Approach to the Spectral Density of Sparse Symmetric Random Matrices
• Spectra of Sparse Random Matrices
• Mean Field Theory For Non-Equilibrium Network Reconstruction
• Rotational invariant estimator for general noisy matrices
• Learning and inference in a nonequilibrium Ising model with hidden nodes
• Non-equilibrium dynamics of gene expression and the Jarzynski equality
• Inference algorithms for gene networks: a statistical mechanics analysis
• Free products of large random matrices - a short review of recent developments
• Belief-Propagation and replicas for inference and learning in a kinetic Ising model with hidden spins
• Inferring hidden states in a random kinetic Ising model: replica analysis
• Variational perturbation and extended Plefka approaches to dynamics on random networks: the case of the kinetic Ising model
• Inference for dynamics of continuous variables: the Extended Plefka Expansion with hidden nodes

Cited by in corpus (7)

• Predicting how and when hidden neurons skew measured synaptic interactions
• Fluctuations of Apparent Entropy Production in Networks with Hidden Slow Degrees of Freedom
• Inference for dynamics of continuous variables: the Extended Plefka Expansion with hidden nodes
• Characterizing spreading dynamics of subsampled systems with non-stationary external input
• Nonequilibrium Green's functions for functional connectivity in the brain
• Random matrix ensemble for the covariance matrix of Ornstein-Uhlenbeck processes with heterogeneous temperatures
• Critical scaling in hidden state inference for linear Langevin dynamics