5 papers
Scalable FastMDP for Pre-departure Airspace Reservation and Strategic De-conflict
Joshua R Bertram, Peng Wei, Joseph Zambreno
Pre-departure flight plan scheduling for Urban Air Mobility (UAM) and cargo delivery drones will require on-demand scheduling of large numbers of aircraft. We examine the scalabili…
An Efficient Algorithm for Multiple-Pursuer-Multiple-Evader Pursuit/Evasion Game
Joshua R. Bertram, Peng Wei
We present a method for pursuit/evasion that is highly efficient and and scales to large teams of aircraft. The underlying algorithm is an efficient algorithm for solving Markov De…
Explainable Deterministic MDPs
Josh Bertram, Peng Wei
We present a method for a certain class of Markov Decision Processes (MDPs) that can relate the optimal policy back to one or more reward sources in the environment. For a given in…
Memoryless Exact Solutions for Deterministic MDPs with Sparse Rewards
Joshua R. Bertram, Peng Wei
We propose an algorithm for deterministic continuous Markov Decision Processes with sparse rewards that computes the optimal policy exactly with no dependency on the size of the st…
Fast Online Exact Solutions for Deterministic MDPs with Sparse Rewards
Joshua R. Bertram, Xuxi Yang, Peng Wei
Markov Decision Processes (MDPs) are a mathematical framework for modeling sequential decision making under uncertainty. The classical approaches for solving MDPs are well known an…