Equilibrium Selection in Multi-Agent Policy Gradients via Opponent-Aware Basin Entry

Yevhen Shcherbinin, Arina Redina, Maxim Kalpin +1

Multi-agent policy-gradient methods have been shown to converge locally near stable Nash equilibria. Local convergence, however, does not determine which equilibrium is reached. We…