Exponential ergodicity for Markov processes with random switching

Abstract

We study a Markov process with two components: the first component evolves according to one of finitely many underlying Markovian dynamics, with a choice of dynamics that changes at the jump times of the second component. The second component is discrete and its jump rates may depend on the position of the whole process. Under regularity assumptions on the jump rates and Wasserstein contraction conditions for the underlying dynamics, we provide a concrete criterion for the convergence to equilibrium in terms of Wasserstein distance. The proof is based on a coupling argument and a weak form of the Harris theorem. In particular, we obtain exponential ergodicity in situations which do not verify any hypoellipticity assumption, but are not uniformly contracting either. We also obtain a bound in total variation distance under a suitable regularising assumption. Some examples are given to illustrate our result, including a class of piecewise deterministic Markov processes.

Published at http://dx.doi.org/10.3150/13-BEJ577 in the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

References in corpus (5)

• Spectral gaps in Wasserstein distances and the 2D stochastic Navier--Stokes equations
• Quantitative ergodicity for some switched dynamical systems
• Tail of a linear diffusion with Markov switching
• A new Poisson-type deviation inequality for Markov jump processes with positive Wasserstein curvature
• Poisson-type deviation inequalities for curved continuous-time Markov chains

Cited by in corpus (23)

• Stochastic switching in infinite dimensions with applications to random parabolic PDEs
• Probabilistic and Piecewise Deterministic models in Biology
• Analysis of Stochastic Gradient Descent in Continuous Time
• Regularity of invariant densities for 1D-systems with random switching
• Smooth invariant densities for random switching on the torus
• Ergodic properties of some piecewise-deterministic Markov process with application to gene expression modelling
• Ergodicity of inhomogeneous Markov chains through asymptotic pseudotrajectories
• Large deviations of Markov chains with multiple time-scales
• Comparison theorem and stability under perturbation of transition rate matrices for regime-switching processes
• Simple Nonlinear Models with Rigorous Extreme Events and Heavy Tails
• Densities for piecewise deterministic Markov processes with boundary
• Vehicle Sequencing at Signal-Free Intersections: Analytical Performance Guarantees Based on PDMP Formulation
• Jump Locations of Jump-Diffusion Processes with State-Dependent Rates
• Exponential ergodicity in the bounded-Lipschitz distance for a subclass of piecewise-deterministic Markov processes with random switching between flows
• On invariant distributions of Feller Markov chains with applications to dynamical systems with random switching
• A Central Limit Theorem for Punctuated Equilibrium
• The central limit theorem for Markov processes that are exponentially ergodic in the bounded-Lipschitz norm
• Sampling from mixture distributions based on regime-switching diffusions
• Randomly switching evolution equations
• A General View on Double Limits in Differential Equations
• Gradient flows and randomised thresholding: sparse inversion and classification
• Law of the Iterated Logarithm for Markov Semigroups with Exponential Mixing in the Wasserstein Distance
• Positive recurrence of a solution of an SDE with variable switching intensities