A Solution to Time-Varying Markov Decision Processes

Lantao Liu, Gaurav S. Sukhatme

We consider a decision-making problem where the environment varies both in space and time. Such problems arise naturally when considering e.g., the navigation of an underwater robo…