Inverse Ising problem in continuous time: A latent variable approach

Abstract

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the likelihood into a form, which allows for simple iterative inference algorithms with analytical updates. The variables are: (1) Poisson variables to linearise an exponential term which is typical for point process likelihoods and (2) Pólya-Gamma variables, which make the likelihood quadratic in the coupling parameters. Using the augmented likelihood, we derive an expectation-maximization (EM) algorithm to obtain the maximum likelihood estimate of network parameters. Using a third set of latent variables we extend the EM algorithm to sparse couplings via L1 regularization. Finally, we develop an efficient approximate Bayesian inference algorithm using a variational approach. We demonstrate the performance of our algorithms on data simulated from an Ising model. For data which are simulated from a more biologically plausible network with spiking neurons, we show that the Ising model captures well the low order statistics of the data and how the Ising couplings are related to the underlying synaptic structure of the simulated network.

10 pages, 4 figures

References in corpus (16)

• Weak pairwise correlations imply strongly correlated network states in a neural population
• Identification of direct residue contacts in protein-protein interaction by message passing
• Inverse statistical problems: from the inverse Ising problem to data science
• The Ising Model for Neural Data: Model Quality and Approximate Methods for Extracting Functional Connectivity
• Mean Field Theory For Non-Equilibrium Network Reconstruction
• The Effect of Nonstationarity on Models Inferred from Neural Data
• Dynamical TAP equations for non-equilibrium Ising spin glasses
• Maximum likelihood reconstruction for Ising models with asynchronous updates
• Learning and inference in a nonequilibrium Ising model with hidden nodes
• Network inference using asynchronously updated kinetic Ising Model
• Approximate Inference for Time-varying Interactions and Macroscopic Dynamics of Neural Populations
• Network Inference with Hidden Units
• Learning with hidden variables
• Belief-Propagation and replicas for inference and learning in a kinetic Ising model with hidden spins
• Inferring hidden states in a random kinetic Ising model: replica analysis
• A statistical physics approach to learning curves for the Inverse Ising problem

Cited by in corpus (9)

• A unifying framework for mean-field theories of asymmetric kinetic Ising systems
• Tackling the subsampling problem to infer collective properties from limited data
• Multi-Class Gaussian Process Classification Made Conjugate: Efficient Inference via Data Augmentation
• Learning phase transitions from regression uncertainty: A new regression-based machine learning approach for automated detection of phases of matter
• Inverse Ising inference from high-temperature re-weighting of observations
• Efficient Bayesian Inference of Sigmoidal Gaussian Cox Processes
• State-space kinetic Ising model reveals task-dependent entropy flow in sparsely active nonequilibrium neuronal dynamics
• Efficient Inference of Flexible Interaction in Spiking-neuron Networks
• Probability Thermodynamics and Probability Quantum Field