activity
20132026
most citedOn the Reduction of Total-Cost and Average-Cost MDPs to Discounted MDPs

3 citations · 3 across the 7 of their papers we have counts for

collaborators
Showing 2026Show all

2 papers · 1 filter

math.OC2026

New Modelling and Solution Frameworks for Multiple Objectives, Decomposability and Impulsivity in Continuous-time Markov Decision Processes

Luke Fairley, Rob Shone, Peter Jacko +1

Impulsive control, in the context of continuous-time Markov decision processes (CTMDPs), refers to actions that instantaneously update the state of the process, leading to theoreti…

cs.CE2026

Markov Decision Process Approximation Methods for Water Distribution Network Inspection and Maintenance: A Case Study of the U.S. Virgin Islands

Minsuk Seo, Daniel A. Eisenberg, Jefferson Huang

We develop a repair-oriented inspection and maintenance decision framework for water distribution networks. This work is motivated by utilities operating in data-sparse environment…