How Exploration Breaks Cooperation in Shared-Policy Multi-Agent Reinforcement Learning

Yi-Ning Weng, Hsuan-Wei Lee

Multi-agent reinforcement learning in dynamic social dilemmas commonly relies on parameter sharing to enable scalability. We show that in shared-policy Deep Q-Network learning, sta…