Federated Control with Hierarchical Multi-Agent Deep Reinforcement Learning
arXiv:1712.08266
Abstract
We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning setup by introducing a meta-controller that guides the communication between agent pairs, enabling agents to focus on communicating with only one other agent at any step. This hierarchical decomposition of the task allows for efficient exploration to learn policies that identify globally optimal solutions even as the number of collaborating agents increases. We show promising initial experimental results on a simulated distributed scheduling problem.
Hierarchical Reinforcement Learning Workshop at the 31st Conference on Neural Information Processing Systems
References in corpus (6)
- Playing Atari with Deep Reinforcement Learning
- Learning to Communicate with Deep Multi-Agent Reinforcement Learning
- Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation
- Learning Multiagent Communication with Backpropagation
- Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
Cited by in corpus (7)
- Deep Reinforcement Learning for Multi-Agent Systems: A Review of Challenges, Solutions and Applications
- Multi-Agent Common Knowledge Reinforcement Learning
- Hierarchical Deep Multiagent Reinforcement Learning with Temporal Abstraction
- AI Research Considerations for Human Existential Safety (ARCHES)
- Feudal Multi-Agent Hierarchies for Cooperative Reinforcement Learning
- Model-based Reinforcement Learning for Service Mesh Fault Resiliency in a Web Application-level
- Multi-Task Federated Reinforcement Learning with Adversaries