A finite state projection algorithm for the stationary solution of the chemical master equation

Abstract

The chemical master equation (CME) is frequently used in systems biology to quantify the effects of stochastic fluctuations that arise due to biomolecular species with low copy numbers. The CME is a system of ordinary differential equations that describes the evolution of probability density for each population vector in the state-space of the stochastic reaction dynamics. For many examples of interest, this state-space is infinite, making it difficult to obtain exact solutions of the CME. To deal with this problem, the Finite State Projection (FSP) algorithm was developed by Munsky and Khammash (Jour. Chem. Phys. 2006), to provide approximate solutions to the CME by truncating the state-space. The FSP works well for finite time-periods but it cannot be used for estimating the stationary solutions of CMEs, which are often of interest in systems biology. The aim of this paper is to develop a version of FSP which we refer to as the stationary FSP (sFSP) that allows one to obtain accurate approximations of the stationary solutions of a CME by solving a finite linear-algebraic system that yields the stationary distribution of a continuous-time Markov chain over the truncated state-space. We derive bounds for the approximation error incurred by sFSP and we establish that under certain stability conditions, these errors can be made arbitrarily small by appropriately expanding the truncated state-space. We provide several examples to illustrate our sFSP method and demonstrate its efficiency in estimating the stationary distributions. In particular, we show that using a quantised tensor train (QTT) implementation of our sFSP method, problems admitting more than 100 million states can be efficiently solved.

8 figures

References in corpus (3)

• A scalable computational framework for establishing long-term behavior of stochastic reaction networks
• Calculating vibrational spectra of molecules using tensor train decomposition
• Adaptive Hybrid Simulations for Multiscale Stochastic Reaction Networks

Cited by in corpus (12)

• Rigorous bounds on the stationary distributions of the chemical master equation via mathematical programming
• Absolutely Robust Controllers for Chemical Reaction Networks
• Tensor-train approximation of the chemical master equation and its application for parameter inference
• Dynamic Bounds on Stochastic Chemical Kinetic Systems Using Semidefinite Programming
• Bounding Transient Moments of Stochastic Chemical Reactions
• Uniformisation techniques for stochastic simulation of chemical reaction networks
• Avoiding matrix exponentials for large transition rate matrices
• A finite state projection method for steady-state sensitivity analysis of stochastic reaction networks
• Interval Analysis of Worst-case Stationary Moments for Stochastic Chemical Reactions with Uncertain Parameters
• Slack Reactants: A State-Space Truncation Framework to Estimate Quantitative Behavior of the Chemical Master Equation
• Improved estimations of stochastic chemical kinetics by finite state expansion
• An algebraic method to calculate parameter regions for constrained steady-state distribution in stochastic reaction networks