Inferring hidden Markov models from noisy time sequences: a method to alleviate degeneracy in molecular dynamics
arXiv:1011.2969 · doi:10.1371/journal.pone.0029703
Abstract
We present a new method for inferring hidden Markov models from noisy time sequences without the necessity of assuming a model architecture, thus allowing for the detection of degenerate states. This is based on the statistical prediction techniques developed by Crutchfield et al., and generates so called causal state models, equivalent to hidden Markov models. This method is applicable to any continuous data which clusters around discrete values and exhibits multiple transitions between these values such as tethered particle motion data or Fluorescence Resonance Energy Transfer (FRET) spectra. The algorithms developed have been shown to perform well on simulated data, demonstrating the ability to recover the model used to generate the data under high noise, sparse data conditions and the ability to infer the existence of degenerate states. They have also been applied to new experimental FRET data of Holliday Junction dynamics, extracting the expected two state model and providing values for the transition rates in good agreement with previous results and with results obtained using existing maximum likelihood based methods.
arXiv comment19 pages, 9 figures
References in corpus (6)
- Computational Mechanics: Pattern and Prediction, Structure and Simplicity
- Learning Rates and States from Biophysical Time Series: A Bayesian Approach to Model Selection and Single-Molecule FRET Data
- Statistical Complexity of Simple 1D Spin Systems
- An Algorithm for Pattern Discovery in Time Series
- DNA Looping Kinetics Analyzed Using Diffusive Hidden Markov Model
- Discovering Planar Disorder in Close-Packed Structures from X-Ray Diffraction: Beyond the Fault Model
Cited by in corpus (22)
- Experiment-friendly kinetic analysis of single molecule data in and out of equilibrium
- Bayesian Structural Inference for Hidden Processes
- Extreme dimensionality reduction with quantum modelling
- Optimal stochastic modelling with unitary quantum dynamics
- Informational and Causal Architecture of Continuous-time Renewal and Hidden Semi-Markov Processes
- Informational and Causal Architecture of Discrete-Time Renewal Processes
- Superior memory efficiency of quantum devices for the simulation of continuous-time stochastic processes
- The classical-quantum divergence of complexity in modelling spin chains
- Structure and Randomness of Continuous-Time Discrete-Event Processes
- Efficient use of single molecule time traces to resolve kinetic rates, models and uncertainties
- Information-theoretic bound on the energy cost of stochastic simulation
- Statistical Signatures of Structural Organization: The case of long memory in renewal processes
- Memory-efficient tracking of complex temporal and symbolic dynamics with quantum simulators
- Fraudulent White Noise: Flat power spectra belie arbitrarily complex processes
- Quantum coarse-graining for extreme dimension reduction in modelling stochastic temporal dynamics
- State aggregations in Markov chains and block models of networks
- The Markov Memory for Generating Rare Events
- Provable superior accuracy in machine learned quantum models
- Extreme Quantum Advantage when Simulating Strongly Coupled Classical Systems
- Surveying structural complexity in quantum many-body systems
- The Origins of Computational Mechanics: A Brief Intellectual History and Several Clarifications
- Measuring complexity