Approximation and inference methods for stochastic biochemical kinetics - a tutorial review

Abstract

Stochastic fluctuations of molecule numbers are ubiquitous in biological systems. Important examples include gene expression and enzymatic processes in living cells. Such systems are typically modelled as chemical reaction networks whose dynamics are governed by the Chemical Master Equation. Despite its simple structure, no analytic solutions to the Chemical Master Equation are known for most systems. Moreover, stochastic simulations are computationally expensive, making systematic analysis and statistical inference a challenging task. Consequently, significant effort has been spent in recent decades on the development of efficient approximation and inference methods. This article gives an introduction to basic modelling concepts as well as an overview of state of the art methods. First, we motivate and introduce deterministic and stochastic methods for modelling chemical networks, and give an overview of simulation and exact solution methods. Next, we discuss several approximation methods, including the chemical Langevin equation, the system size expansion, moment closure approximations, time-scale separation approximations and hybrid methods. We discuss their various properties and review recent advances and remaining challenges for these methods. We present a comparison of several of these methods by means of a numerical case study and highlight some of their respective advantages and disadvantages. Finally, we discuss the problem of inference from experimental data in the Bayesian framework and review recent methods developed the literature. In summary, this review gives a self-contained introduction to modelling, approximations and inference methods for stochastic chemical kinetics.

73 pages, 12 figures in J. Phys. A: Math. Theor. (2016)

References in corpus (49)

• Epidemic processes in complex networks
• Analytical distributions for stochastic gene expression
• A modified Next Reaction Method for simulating chemical systems with time dependent propensities and delays
• Stochastic modelling of reaction-diffusion processes: algorithms for bimolecular reactions
• Colored extrinsic fluctuations and stochastic gene expression
• Stochastic Models of Evolution in Genetics, Ecology and Linguistics
• Exact distributions for stochastic gene expression models with bursting and feedback
• Pooling single-cell recordings: Scalable inference through heterogeneous kinetics
• Noise-Induced Bistable States and Their Mean Switching Time in Foraging Colonies
• Steady-state fluctuations of a genetic feedback loop: an exact solution
• Incorporating postleap checks in tau-leaping
• Intrinsic noise in systems with switching environments
• Markovian Dynamics on Complex Reaction Networks
• Comparison of different moment-closure approximations for stochastic chemical kinetics
• Stochastic Simulation of Biomolecular Networks in Dynamic Environments
• Amplified biochemical oscillations in cellular systems
• A Convergent Reaction-Diffusion Master Equation
• A First-Passage Kinetic Monte Carlo Algorithm for Complex Diffusion-Reaction Systems
• A "partitioned leaping" approach for multiscale modeling of chemical reaction dynamics
• Inference for reaction networks using the Linear Noise Approximation
• On the Reaction Diffusion Master Equation in the Microscopic Limit
• A general moment expansion method for stochastic kinetic models
• Noise-induced multistability in chemical systems: Discrete vs Continuum modeling
• The complex chemical Langevin equation
• Coarse graining of master equations with fast and slow states
• Validity conditions for moment closure approximations in stochastic chemical kinetics
• Limitations of the stochastic quasi-steady-state approximation in open biochemical reaction networks
• The interplay of intrinsic and extrinsic bounded noises in genetic networks
• Rigorous elimination of fast stochastic variables from the linear noise approximation using projection operators
• Enhanced stochastic oscillations in autocatalytic reactions
• A jump-growth model for predator-prey dynamics: derivation and application to marine ecosystems
• Hybrid framework for the simulation of stochastic chemical kinetics
• Adaptive Hybrid Simulations for Multiscale Stochastic Reaction Networks
• MCMC inference for Markov Jump Processes via the Linear Noise Approximation
• Cox process representation and inference for stochastic reaction-diffusion processes
• Stochastic theory of large-scale enzyme-reaction networks: Finite copy number corrections to rate equation models
• Mixed Poisson distributions in exact solutions of stochastic auto-regulation models
• Approximate probability distributions of the master equation
• Efficient statistical inference for stochastic reaction processes
• Model reduction for stochastic chemical systems with abundant species
• Stochastic Wilson-Cowan models of neuronal network dynamics with memory and delay
• Bayesian Inference for Hybrid Discrete-Continuous Stochastic Kinetic Models
• Computation of biochemical pathway fluctuations beyond the linear noise approximation using iNA
• Synchronisation of stochastic oscillators in biochemical systems
• Corrections to the Law of Mass Action and Properties of the Asymptotic $t=\infty$ State for Reversible Diffusion-Limited Reactions
• Non-equilibrium Lyapunov function and a fluctuation relation for stochastic systems: Poisson representation approach
• Expectation propagation for continuous time stochastic processes
• Analytical study of non Gaussian fluctuations in a stochastic scheme of autocatalytic reactions
• Self-regulating genes. Exact steady state solution by using Poisson Representation

Cited by in corpus (54)

• Master equations and the theory of stochastic path integrals
• Simulation and inference algorithms for stochastic biochemical reaction networks: from basic concepts to state-of-the-art
• Exact solution of stochastic gene expression models with bursting, cell cycle and replication dynamics
• Learning differential equation models from stochastic agent-based model simulations
• Stochastic modeling of auto-regulatory genetic feedback loops: a review and comparative study
• Interacting particle solutions of Fokker-Planck equations through gradient-log-density estimation
• Single-cell stochastic gene expression kinetics with coupled positive-plus-negative feedback
• Interlacing Relaxation and First-Passage Phenomena in Reversible Discrete and Continuous Space Markovian Dynamics
• Memory functions reveal structural properties of gene regulatory networks
• Stochastic gene expression with a multistate promoter: breaking down exact distributions
• Stochastic reaction networks in dynamic compartment populations
• Stochastic Hybrid Models of Gene Regulatory Networks - A PDE Approach
• Parameter estimation for biochemical reaction networks using Wasserstein distances
• Rigorous bounds on the stationary distributions of the chemical master equation via mathematical programming
• Extending the linear-noise approximation to biochemical systems influenced by intrinsic noise and slow lognormally distributed extrinsic noise
• Designing molecular circuits for approximate maximum a posteriori demodulation of concentration modulated signals
• A practical guide to pseudo-marginal methods for computational inference in systems biology
• Analysis of stochastic bifurcations with phase portraits
• Efficient Low-Order Approximation of First-Passage Time Distributions
• Construction of quasi-potentials for stochastic dynamical systems: an optimization approach
• Stochastic Chemical Reaction Networks for Robustly Approximating Arbitrary Probability Distributions
• Tractable nonlinear memory functions as a tool to capture and explain dynamical behaviours
• Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
• Solving Moment Hierarchies for Chemical Reaction Networks
• Analytic solutions for stochastic hybrid models of gene regulatory networks
• On non-ideal chemical-reaction networks and phase separation
• Quasi-Monte Carlo methods applied to tau-leaping in stochastic biological systems
• Model Reduction for the Chemical Master Equation: an Information-Theoretic Approach
• Sample size dependence of tagged molecule dynamics in steady-state networks with bimolecular reactions: Cycle times of a light-driven pump
• Uniformisation techniques for stochastic simulation of chemical reaction networks
• Robustly simulating biochemical reaction kinetics using multi-level Monte Carlo approaches
• Field theories and quantum methods for stochastic reaction-diffusion systems
• Autoregressive Point-Processes as Latent State-Space Models: a Moment-Closure Approach to Fluctuations and Autocorrelations
• Regulation of stem cell dynamics through volume exclusion
• Coupled differentiation and division of embryonic stem cells inferred from clonal snapshots
• Transition in relaxation paths in allosteric molecules: enzymatic kinetically constrained model
• Geometric fluid approximation for general continuous-time Markov chains
• Neutral dynamics and cell renewal of colonic crypts in homeostatic regime
• Multifidelity Approximate Bayesian Computation with Sequential Monte Carlo Parameter Sampling
• Uniform convergence of solutions to stochastic hybrid models of gene regulatory networks
• Molecular Noise In Synaptic Communication
• The generic temperature response of large biochemical networks
• Macroscopic fluctuation-response theory and its use for gene regulatory networks
• Risk aversion can promote cooperation
• Dynamics of systems with varying number of particles: from Liouville equations to general master equations for open systems
• Insights into the relation between noise and biological complexity
• Dynamic scaling theory for a field quench near the Kasteleyn transition in spin ice
• Efficient stochastic simulation of gene regulatory networks using hybrid models of transcriptional bursting
• Relation between the convective field and the stationary probability distribution of chemical reaction networks
• Improved estimations of stochastic chemical kinetics by finite state expansion
• Non-equilibrium time-dependent solution to discrete choice with social interactions
• Dynamic scaling near the Kasteleyn transition in spin ice: critical relaxation of monopoles and strings following a field quench
• An algebraic method to calculate parameter regions for constrained steady-state distribution in stochastic reaction networks
• Fast reactions with non-interacting species in stochastic reaction networks