Learning Complex Multi-Agent Policies in Presence of an Adversary

Abstract

In recent years, there has been some outstanding work on applying deep reinforcement learning to multi-agent settings. Often in such multi-agent scenarios, adversaries can be present. We address the requirements of such a setting by implementing a graph-based multi-agent deep reinforcement learning algorithm. In this work, we consider the scenario of multi-agent deception in which multiple agents need to learn to cooperate and communicate in order to deceive an adversary. We have employed a two-stage learning process to get the cooperating agents to learn such deceptive behaviors. Our experiments show that our approach allows us to employ curriculum learning to increase the number of cooperating agents in the environment and enables a team of agents to learn complex behaviors to successfully deceive an adversary. Keywords: Multi-agent system, Graph neural network, Reinforcement learning

References in corpus (12)

• Continuous control with deep reinforcement learning
• Playing Atari with Deep Reinforcement Learning
• Learning to Communicate with Deep Multi-Agent Reinforcement Learning
• Learning a Generic Value-Selection Heuristic Inside a Constraint Programming Solver
• Counterfactual Multi-Agent Policy Gradients
• Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problems
• Learning Multiagent Communication with Backpropagation
• Continuous Adaptation via Meta-Learning in Nonstationary and Competitive Environments
• Opponent Modeling in Deep Reinforcement Learning
• Learning Policy Representations in Multiagent Systems
• Probabilistic Recursive Reasoning for Multi-Agent Reinforcement Learning
• TarMAC: Targeted Multi-Agent Communication

Cited by in corpus (1)

• Deception in Social Learning: A Multi-Agent Reinforcement Learning Perspective