Learning to Cooperate via Policy Search
arXiv:1408.1484
Abstract
Cooperative games are those in which both agents share the same payoff structure. Value-based reinforcement-learning algorithms, such as variants of Q-learning, have been applied to learning cooperative games, but they only apply when the game state is completely observable to both agents. Policy search methods are a reasonable alternative to value-based methods for partially observable environments. In this paper, we provide a gradient-based distributed policy-search method for cooperative games and compare the notion of local optimum to that of Nash equilibrium. We demonstrate the effectiveness of this method experimentally in a small, partially observable simulated soccer domain.
Appears in Proceedings of the Sixteenth Conference on Uncertainty in Artificial Intelligence (UAI2000)
References in corpus (1)
Cited by in corpus (5)
- The Communicative Multiagent Team Decision Problem: Analyzing Teamwork Theories and Models
- The Complexity of Decentralized Control of Markov Decision Processes
- Decentralized Control of Cooperative Systems: Categorization and Complexity Analysis
- MAA*: A Heuristic Search Algorithm for Solving Decentralized POMDPs
- Rollout Sampling Policy Iteration for Decentralized POMDPs