Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis

Abstract

We study the ergodic control problem for a class of controlled jump diffusions driven by a compound Poisson process. This extends the results of [SIAM J. Control Optim. 57 (2019), no. 2, 1516-1540] to running costs that are not near-monotone. This generality is needed in applications such as optimal scheduling of large-scale parallel server networks. We provide a full characterization of optimality via the Hamilton-Jacobi-Bellman (HJB) equation, for which we additionally exhibit regularity of solutions under mild hypotheses. In addition, we show that optimal stationary Markov controls are a.s. pathwise optimal. Lastly, we show that one can fix a stable control outside a compact set and obtain near-optimal solutions by solving the HJB on a sufficiently large bounded domain. This is useful for constructing asymptotically optimal scheduling policies for multiclass parallel server networks.

arXiv comment20 pages

References in corpus (10)

• Ergodic control of multi-class $M/M/N+M$ queues in the Halfin-Whitt regime
• Ergodicity of Lévy-driven SDEs arising from multiclass many-server queues
• Ergodic Diffusion Control of Multiclass Multi-Pool Networks in the Halfin-Whitt Regime
• Infinite horizon asymptotic average optimality for large-scale parallel server networks
• Ergodic control of a class of jump diffusions with finite Lévy measures and rough kernels
• Infinite Horizon Average Optimality of the N-network Queueing Model in the Halfin-Whitt Regime
• Optimal control of Markov-modulated multiclass many-server queues
• Some new results on sample path optimality in ergodic control of diffusions
• On uniform exponential ergodicity of Markovian multiclass many-server queues in the Halfin-Whitt regime
• Optimal scheduling of critically loaded multiclass GI/M/n+M queues in an alternating renewal environment