Multiscale Markov Decision Problems: Compression, Solution, and Transfer Learning

Jake Bouvrie, Mauro Maggioni

Many problems in sequential decision making and stochastic control often have natural multiscale structure: sub-tasks are assembled together to accomplish complex goals. Systematic…