Simulating non-Markovian stochastic processes

Abstract

We present a simple and general framework to simulate statistically correct realizations of a system of non-Markovian discrete stochastic processes. We give the exact analytical solution and a practical an efficient algorithm alike the Gillespie algorithm for Markovian processes, with the difference that now the occurrence rates of the events depend on the time elapsed since the event last took place. We use our non-Markovian generalized Gillespie stochastic simulation methodology to investigate the effects of non-exponential inter-event time distributions in the susceptible-infected-susceptible model of epidemic spreading. Strikingly, our results unveil the drastic effects that very subtle differences in the modeling of non-Markovian processes have on the global behavior of complex systems, with important implications for their understanding and prediction. We also assess our generalized Gillespie algorithm on a system of biochemical reactions with time delays. As compared to other existing methods, we find that the generalized Gillespie algorithm is the most general as it can be implemented very easily in cases, like for delays coupled to the evolution of the system, where other algorithms do not work or need adapted versions, less efficient in computational terms.

Improvement of the algorithm, new results, and a major reorganization of the paper thanks to our coauthors L. Lafuerza and R. Toral

References in corpus (7)

• A Poissonian explanation for heavy-tails in e-mail communication
• On Universality in Human Correspondence Activity
• Dynamical and bursty interactions in social networks
• Social network dynamics of face-to-face interactions
• Microdynamics in stationary complex networks
• Spreading Dynamics Following Bursty Human Activity Patterns
• Update rules and interevent time distributions: Slow ordering vs. no ordering in the Voter Model

Cited by in corpus (39)

• Epidemic processes in complex networks
• Memory effects on epidemic evolution: The susceptible-infected-recovered epidemic model
• Temporal Gillespie algorithm: Fast simulation of contagion processes on time-varying networks
• Dynamical Systems on Networks: A Tutorial
• Pairwise-like models for non-Markovian epidemics on networks
• The effects of network structure, competition and memory time on social spreading phenomena
• A Gillespie algorithm for non-Markovian stochastic processes
• Optimized Gillespie algorithms for the simulation of Markovian epidemic processes on large and heterogeneous networks
• Equivalence between non-Markovian and Markovian dynamics in epidemic spreading processes
• Chemical continuous time random walks
• Non-Markovian SIR epidemic spreading model
• Ordering dynamics in the voter model with aging
• First-passage distributions for the one-dimensional Fokker-Planck equation
• Aging-induced continuous phase transition
• Solvable non-Markovian dynamic network
• Aging effects in Schelling Segregation model
• Self-initiated behavioural change and disease resurgence on activity-driven networks
• Gillespie algorithms for stochastic multiagent dynamics in populations and network
• Burstiness in activity-driven networks and the epidemic threshold
• Small inter-event times govern epidemic spreading on temporal networks
• Stochastic collision model approach to transport phenomena in quantum networks
• Non-Markovian epidemic spreading on temporal networks
• Simulating SIR processes on networks using weighted shortest paths
• Non-Markovian Majority-Vote model
• Aging in binary-state models: The Threshold model for Complex Contagion
• Noise Processing by MicroRNA-Mediated Circuits: the Incoherent Feed-Forward Loop, Revisited
• Unifying continuous, discrete, and hybrid susceptible-infected-recovered processes on networks
• Stochastic Kuramoto oscillators with discrete phase states
• Reduction from non-Markovian to Markovian dynamics: The case of aging in the noisy-voter model
• Analytical and numerical treatment of continuous ageing in the voter model
• Memory-induced complex contagion in epidemic spreading
• Mean-field models for non-Markovian epidemics on networks: from edge-based compartmental to pairwise models
• Effect of memory in non-Markovian Boolean networks
• Noisy kinetic-exchange opinion model with aging
• Rejection-Based Simulation of Non-Markovian Agents on Complex Networks
• Non-Markovian effects in the growth of a polymer chain
• Pricing cyber insurance for a large-scale network
• Generating functionals and Gaussian approximations for interruptible delay reactions
• A multi-stage representation of cell proliferation as a Markov process