4 papers
Markov Decision Process Approximation Methods for Water Distribution Network Inspection and Maintenance: A Case Study of the U.S. Virgin Islands
Minsuk Seo, Daniel A. Eisenberg, Jefferson Huang
We develop a repair-oriented inspection and maintenance decision framework for water distribution networks. This work is motivated by utilities operating in data-sparse environment…
Convergence of Fast Policy Iteration in Markov Games and Robust MDPs
Keith Badger, Jefferson Huang, Marek Petrik
Markov games and robust MDPs are closely related models that involve computing a pair of saddle point policies. As part of the long-standing effort to develop efficient algorithms…
A Bi-Objective Markov Decision Process Design approach to redundancy allocation with dynamic maintenance for a parallel system
Luke Fairley, Rob Shone, Peter Jacko +1
The reliability of a system can be improved by the addition of redundant elements, giving rise to the well-known redundancy allocation problem (RAP). We propose a novel extension t…
Computing optimal policies for managing inventories with noisy observations
Eugene Feinberg, Jefferson Huang, Pavlo Kasyanov +1
This paper implements the Deep Deterministic Policy Gradient (DDPG) algorithm for computing optimal policies for partially observable single-product periodic review inventory contr…