The Elusive Present: Hidden Past and Future Dependency and Why We Build Models
arXiv:1507.00672 · doi:10.1103/PhysRevE.93.022143
Abstract
Modeling a temporal process as if it is Markovian assumes the present encodes all of the process's history. When this occurs, the present captures all of the dependency between past and future. We recently showed that if one randomly samples in the space of structured processes, this is almost never the case. So, how does the Markov failure come about? That is, how do individual measurements fail to encode the past? And, how many are needed to capture dependencies between the past and future? Here, we investigate how much information can be shared between the past and future, but not be reflected in the present. We quantify this elusive information, give explicit calculational methods, and draw out the consequences. The most important of which is that when the present hides past-future dependency we must move beyond sequence-based statistics and build state-based models.
arXiv comment12 pages, 10 figures; http://csc.ucdavis.edu/~cmg/compmech/pubs/tep.htm
References in corpus (11)
- Nonnegative Decomposition of Multivariate Information
- Anatomy of a Bit: Information in a Time Series Observation
- Prediction, Retrodiction, and The Amount of Information Stored in the Present
- Exact Synchronization for Finite-State Sources
- Many Roads to Synchrony: Natural Time Scales and Their Algorithms
- Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation
- Asymptotic Synchronization for Finite-State Sources
- Equivalence of History and Generator Epsilon-Machines
- A measure of statistical complexity based on predictive information
- The Past and the Future in the Present
- Properties of Persistent Mutual Information and Emergence