A Unified Theory of Compositionality, Modularity, and Interpretability in Markov Decision Processes

Thomas J. Ringstrom, Paul R. Schrater

We introduce Option Kernel Bellman Equations (OKBEs) for a new reward-free Markov Decision Process. Rather than a value function, OKBEs directly construct and optimize a predictive…