On the Heterogeneity of Independent Learning Dynamics in Zero-sum Stochastic Games

Muhammed O. Sayin, K. Alperen Cetiner

We analyze the convergence properties of the two-timescale fictitious play combining the classical fictitious play with the Q-learning for two-player zero-sum stochastic games with…