Reinforcement Learning in Low-Rank MDPs with Density Features

Audrey Huang, Jinglin Chen, Nan Jiang

MDPs with low-rank transitions -- that is, the transition matrix can be factored into the product of two matrices, left and right -- is a highly representative structure that enabl…