Metastability in Markov processes

Abstract

We present a formalism to describe slowly decaying systems in the context of finite Markov chains obeying detailed balance. We show that phase space can be partitioned into approximately decoupled regions, in which one may introduce restricted Markov chains which are close to the original process but do not leave these regions. Within this context, we identify the conditions under which the decaying system can be considered to be in a metastable state. Furthermore, we show that such metastable states can be described in thermodynamic terms and define their free energy. This is accomplished showing that the probability distribution describing the metastable state is indeed proportional to the equilibrium distribution, as is commonly assumed. We test the formalism numerically in the case of the two-dimensional kinetic Ising model, using the Wang--Landau algorithm to show this proportionality explicitly, and confirm that the proportionality constant is as derived in the theory. Finally, we extend the formalism to situations in which a system can have several metastable states.

30 pages, 5 figures; version with one higher quality figure available at http://www.fis.unam.mx/~dsanders/

References in corpus (12)

• An efficient, multiple range random walk algorithm to calculate the density of states
• Determining the density of states for classical statistical models: A random walk algorithm to produce a flat histogram
• Metastable lifetimes in a kinetic Ising model: Dependence on field and system size
• Understanding and Improving the Wang-Landau Algorithm
• Wang-Landau algorithm for continuous models and joint density of states
• Metastable states in glassy systems
• Metastability in Glauber dynamics in the low-temperature limit: Beyond exponential asymptotics
• Multiple phases in stochastic dynamics: geometry and probabilities
• Metastability and Nucleation for the Blume-Capel Model. Different mechanisms of transition
• Coarse grains: the emergence of space and order
• Fluctuation-Dissipation Theorem for Metastable Systems
• Reconstruction of the Free Energy in the Metastable Region using the Path Ensemble

Cited by in corpus (3)

• Non-equilibrium Characterization of Spinodal Points using Short Time Dynamics
• Competitive nucleation and the Ostwald rule in a generalized Potts model with multiple metastable phases
• Understanding random-walk dynamical phase coexistence through waiting times