Causality inference in stochastic systems from neurons to currencies: Profiting from small sample size
arXiv:1705.06384 · doi:10.1103/PhysRevE.99.023311
Abstract
Success in modeling complex phenomena such as human perception hinges critically on the availability of data and computational power. Significant progress has been made in modeling such phenomena using probabilistic methods, particularly in image analysis and speech recognition. Maximum Likelihood Estimation (MLE) combined with Bayesian model selection is the basis of much of this progress, as MLE converges to the true model with copious data. In the sciences, large enough datasets are rarae aves, so alternatives to MLE must be developed for small sample size. We introduce a data-driven statistical physics approach to model inference based on minimizing a free energy of data and show superior model recovery for small sample sizes. We demonstrate coupling strength inference in non-equilibrium kinetic Ising models, including in the difficult large coupling variability regime, and show scaling to systems of arbitrary size. As applications, we infer a functional connectivity network in the salamander retina and a currency exchange rate network from time-series data of neuronal spiking and currency exchange rates, respectively. Accurate small sample size inference is critical for devising a profitable currency hedging strategy.
arXiv comment6 pages, 5 figures
References in corpus (14)
- Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
- Weak pairwise correlations imply strongly correlated network states in a neural population
- Identification of direct residue contacts in protein-protein interaction by message passing
- Whole-brain calcium imaging with cellular resolution in freely behaving C. elegans
- Maximum entropy models for antibody diversity
- Searching for collective behavior in a network of real neurons
- Inverse statistical problems: from the inverse Ising problem to data science
- Mean Field Theory For Non-Equilibrium Network Reconstruction
- Pseudolikelihood Decimation Algorithm Improving the Inference of the Interaction Network in a General Class of Ising Models
- Maximum likelihood reconstruction for Ising models with asynchronous updates
- Market structure explained by pairwise interactions
- Generalized mean field approximation for parallel dynamics of the Ising model
- Dynamics of asymmetric kinetic Ising systems revisited
- Sparse Hopfield network reconstruction with regularization
Cited by in corpus (5)
- netrd: A library for network reconstruction and graph distances
- Data-driven inference of hidden nodes in networks
- Inference of stochastic time series with missing data
- Inverse Ising inference from high-temperature re-weighting of observations
- Inferring, comparing and exploring ecological networks from time-series data through R packages constructnet, disgraph and dynet