Generalised Bellman recurrence and three dualities in sequential decision-making

Fernando E. Rosas, David Hyland, Daniel Polani

What gives the Bellman equation its form? We show that the recursive properties of optimal value functions follow from three conditions: that the dynamics decomposes through suffic…