Convex Q Learning in a Stochastic Environment: Extended Version

Fan Lu, Sean Meyn

The paper introduces the first formulation of convex Q-learning for Markov decision processes with function approximation. The algorithms and theory rest on a relaxation of a dual…