Deeptime: a Python library for machine learning dynamical models from time series data

Abstract

Generation and analysis of time-series data is relevant to many quantitative fields ranging from economics to fluid mechanics. In the physical sciences, structures such as metastable and coherent sets, slow relaxation processes, collective variables dominant transition pathways or manifolds and channels of probability flow can be of great importance for understanding and characterizing the kinetic, thermodynamic and mechanistic properties of the system. Deeptime is a general purpose Python library offering various tools to estimate dynamical models based on time-series data including conventional linear learning methods, such as Markov state models (MSMs), Hidden Markov Models and Koopman models, as well as kernel and deep learning approaches such as VAMPnets and deep MSMs. The library is largely compatible with scikit-learn, having a range of Estimator classes for these different models, but in contrast to scikit-learn also provides deep Model classes, e.g. in the case of an MSM, which provide a multitude of analysis methods to compute interesting thermodynamic, kinetic and dynamical quantities, such as free energies, relaxation times and transition paths. The library is designed for ease of use but also easily maintainable and extensible code. In this paper we introduce the main features and structure of the deeptime software.

References in corpus (47)

• Adam: A Method for Stochastic Optimization
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Auto-Encoding Variational Bayes
• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• A Data-Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
• On Dynamic Mode Decomposition: Theory and Applications
• Deep learning for universal linear embeddings of nonlinear dynamics
• Identification of slow molecular order parameters for Markov model construction
• Data-driven discovery of coordinates and governing equations
• Sparsity-promoting dynamic mode decomposition
• Chaos as an Intermittently Forced Linear System
• VAMPnets: Deep learning of molecular kinetics
• Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
• Time-lagged autoencoders: Deep learning of slow collective variables for molecular kinetics
• De-Biasing the Dynamic Mode Decomposition for Applied Koopman Spectral Analysis
• Characterizing and correcting for the effect of sensor noise in the dynamic mode decomposition
• Data-driven approximation of the Koopman generator: Model reduction, system identification, and control
• Data-driven model reduction and transfer operator approximation
• Molecular enhanced sampling with autoencoders: On-the-fly collective variable discovery and accelerated free energy landscape exploration
• Sparse learning of stochastic dynamic equations
• Variational cross-validation of slow dynamical modes in molecular kinetics
• Transport in time-dependent dynamical systems: Finite-time coherent sets
• Variational Encoding of Complex Dynamics
• On the numerical approximation of the Perron-Frobenius and Koopman operator
• sktime: A Unified Interface for Machine Learning with Time Series
• A Spectral Clustering Approach to Lagrangian Vortex Detection
• Using Noisy or Incomplete Data to Discover Models of Spatiotemporal Dynamics
• Randomized Dynamic Mode Decomposition
• On the Lagrangian Dynamics of Atmospheric Zonal Jets and the Permeability of the Stratospheric Polar Vortex
• Eigendecompositions of Transfer Operators in Reproducing Kernel Hilbert Spaces
• Understanding the geometry of transport: diffusion maps for Lagrangian trajectory data unravel coherent sets
• Low-order model for successive bifurcations of the fluidic pinball
• Nonlinear stochastic modeling with Langevin regression
• Markov State Models from short non-Equilibrium Simulations - Analysis and Correction of Estimation Bias
• Variational Selection of Features for Molecular Kinetics
• Multidimensional approximation of nonlinear dynamical systems
• Robust and optimal sparse regression for nonlinear PDE models
• Deep Generative Markov State Models
• Optimal data-driven estimation of generalized Markov state models for non-equilibrium dynamics
• Kernel methods for detecting coherent structures in dynamical data
• Bayesian hidden Markov model analysis of single-molecule force spectroscopy: Characterizing kinetics under measurement uncertainty
• Learning Dynamical Systems and Bifurcation via Group Sparsity
• Deflation reveals dynamical structure in nondominant reaction coordinates
• Simultaneous Coherent Structure Coloring facilitates interpretable clustering of scientific data by amplifying dissimilarity
• Progress in deep Markov State Modeling: Coarse graining and experimental data restraints