3 papers
math.PR2025
Decay property of a class of d-dimensional Markov processes
Yanyun Li
In this paper, we consider the decay property of a special class of -dimensional Markov processes, which can be viewed as a stopped network with the external customer being bloc…
math.PR2025
Reach-avoid semi-Markov decision processes with time-varying obstacles
Yanyun Li, Xianping Guo
We consider the maximal reach-avoid probability to a target in finite horizon for semi-Markov decision processes with time-varying obstacles. Since the variance of the obstacle set…
math.OC2025
On reachability of Markov decision processes: a novel state-classification-based PI approach
Yanyun Li, Xin Guo, Xianping Guo
This paper concentrates on the reliability of a discrete-time controlled Markov system with finite states and actions, and aims to give an efficient algorithm for obtaining an opti…