Emergence of Theory of Mind Collaboration in Multiagent Systems
arXiv:2110.00121
Abstract
Currently, in the study of multiagent systems, the intentions of agents are usually ignored. Nonetheless, as pointed out by Theory of Mind (ToM), people regularly reason about other's mental states, including beliefs, goals, and intentions, to obtain performance advantage in competition, cooperation or coalition. However, due to its intrinsic recursion and intractable modeling of distribution over belief, integrating ToM in multiagent planning and decision making is still a challenge. In this paper, we incorporate ToM in multiagent partially observable Markov decision process (POMDP) and propose an adaptive training algorithm to develop effective collaboration between agents with ToM. We evaluate our algorithms with two games, where our algorithm surpasses all previous decentralized execution algorithms without modeling ToM.
References in corpus (12)
- Playing Atari with Deep Reinforcement Learning
- Learning to Communicate with Deep Multi-Agent Reinforcement Learning
- Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
- Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
- Reinforcement Learning with Deep Energy-Based Policies
- Emergence of Grounded Compositional Language in Multi-Agent Populations
- A Survey of Learning in Multiagent Environments: Dealing with Non-Stationarity
- Multi-Agent Cooperation and the Emergence of (Natural) Language
- Learning to Communicate to Solve Riddles with Deep Distributed Recurrent Q-Networks
- Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Learning
- Monte Carlo Sampling Methods for Approximating Interactive POMDPs
- Emergent Communication in a Multi-Modal, Multi-Step Referential Game