4 papers
Decay property of a class of d-dimensional Markov processes
Yanyun Li
In this paper, we consider the decay property of a special class of -dimensional Markov processes, which can be viewed as a stopped network with the external customer being bloc…
Reach-avoid semi-Markov decision processes with time-varying obstacles
Yanyun Li, Xianping Guo
We consider the maximal reach-avoid probability to a target in finite horizon for semi-Markov decision processes with time-varying obstacles. Since the variance of the obstacle set…
On reachability of Markov decision processes: a novel state-classification-based PI approach
Yanyun Li, Xin Guo, Xianping Guo
This paper concentrates on the reliability of a discrete-time controlled Markov system with finite states and actions, and aims to give an efficient algorithm for obtaining an opti…
The minimal hitting probability of continuous-time controlled Markov systems with countable states
Yanyun Li, Junping Li
This paper concentrates on the minimal hitting probability of continuous-time controlled Markov systems (CTCMSs) with countable state and finite admissible action spaces. The exist…