Temporal Concatenation for Markov Decision Processes

Ruiyang Song, Kuang Xu

We propose and analyze a temporal concatenation heuristic for solving large-scale finite-horizon Markov decision processes (MDP), which divides the MDP into smaller sub-problems al…