Faster Reinforcement Learning by Freezing Slow States

Yijia Wang, Daniel R. Jiang

We study infinite horizon Markov decision processes (MDPs) with "fast-slow" structure, where some state variables evolve rapidly ("fast states") while others change more gradually…