Cooperative and Distributed Reinforcement Learning of Drones for Field Coverage

Abstract

This paper proposes a distributed Multi-Agent Reinforcement Learning (MARL) algorithm for a team of Unmanned Aerial Vehicles (UAVs). The proposed MARL algorithm allows UAVs to learn cooperatively to provide a full coverage of an unknown field of interest while minimizing the overlapping sections among their field of views. Two challenges in MARL for such a system are discussed in the paper: firstly, the complex dynamic of the joint-actions of the UAV team, that will be solved using game-theoretic correlated equilibrium, and secondly, the challenge in huge dimensional state space representation will be tackled with efficient function approximation techniques. We also provide our experimental results in detail with both simulation and physical implementation to show that the UAV team can successfully learn to accomplish the task.

References in corpus (2)

• Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
• Autonomous UAV Navigation Using Reinforcement Learning

Cited by in corpus (11)

• RODE: Learning Roles to Decompose Multi-Agent Tasks
• Multi-Agent Common Knowledge Reinforcement Learning
• Multi-Agent Reinforcement Learning: Methods, Applications, Visionary Prospects, and Challenges
• A Deep Ensemble Multi-Agent Reinforcement Learning Approach for Air Traffic Control
• Network Support for High-performance Distributed Machine Learning
• Context-Aware Sparse Deep Coordination Graphs
• Multi-Agent Reinforcement Learning for Unmanned Aerial Vehicle Coordination by Multi-Critic Policy Gradient Optimization
• Multi-vehicle Flocking Control with Deep Deterministic Policy Gradient Method
• Responsive Regulation of Dynamic UAV Communication Networks Based on Deep Reinforcement Learning
• Time-Efficient Mars Exploration of Simultaneous Coverage and Charging with Multiple Drones
• Deep Reinforcement Learning using Genetic Algorithm for Parameter Optimization