From empirical data to continuous Markov processes: a systematic approach
arXiv:1510.07282 · doi:10.1103/PhysRevE.93.032135
Abstract
We present an approach for testing for the existence of continuous generators of discrete stochastic transition matrices. Typically, the known approaches to ascertain the existence of continuous Markov processes are based in the assumption that only time-homogeneous generators exist. Here, a systematic extension to time-inhomogeneity is presented, based in new mathematical propositions incorporating necessary and sufficient conditions, which are then implemented computationally and applied to numerical data. A discussion concerning the bridging between rigorous mathematical results on the existence of generators to its computational implementation. Our detection algorithm shows to be effective in more than of tested matrices, typically to , and for those an estimate of the (non-homogeneous) generator matrix follows. We also solve the embedding problem analytically for the particular case of three-dimensional circulant matrices. Finally, a discussion of possible applications of our framework to problems in different fields is briefly addressed.
12 pages, 2 figures
References in corpus (1)
Cited by in corpus (12)
- Stochastic thermodynamics of computation
- Non-Markovianity and negative entropy production rates
- Thermodynamics of computing with circuits
- Quantum advantage in simulating stochastic processes
- Number of hidden states needed to physically implement a given conditional distribution
- A space-time tradeoff for implementing a function with master equation dynamics
- A solution to the reversible embedding problem for finite Markov chains
- Systematics and symmetry in molecular phylogenetic modelling: perspectives from physics
- Accessible maps in a group of classical or quantum channels
- Notes on Markov embedding
- A Markov model for inferring flows in directed contact networks
- Demon with dementia - the deterioration of information transcription