21 citations · 47 across the 12 of their papers we have counts for
4 papers · 1 filter
An Overview for Markov Decision Processes in Queues and Networks
Quan-Lin Li, Jing-Yu Ma, Rui-Na Fan +1
Markov decision processes (MDPs) in queues and networks have been an interesting topic in many practical areas since the 1960s. This paper provides a detailed overview on this topi…
A Complete Algebraic Solution to the Optimal Dynamic Rationing Policy in the Stock-Rationing Queue with Two Demand Classes
Quan-Lin Li, Yi-Meng Li, Jing-Yu Ma +1
In this paper, we study a stock-rationing queue with two demand classes by means of the sensitivity-based optimization, and develop a complete algebraic solution to the optimal dyn…
Markov Processes in Blockchain Systems
Quan-Lin Li, Jing-Yu Ma, Yan-Xia Chang +2
In this paper, we develop a more general framework of block-structured Markov processes in the queueing study of blockchain systems, which can provide analysis both for the station…
Optimal Asynchronous Dynamic Policies in Energy-Efficient Data Centers
Jing-Yu Ma, Quan-Lin Li, Li Xia
In this paper, we use a Markov decision process to find optimal asynchronous policy of an energy-efficient data center with two groups of heterogeneous servers, a finite buffer, an…