Towards Joint Learning of Optimal MAC Signaling and Wireless Channel Access
arXiv:2007.09948 · doi:10.1109/TCCN.2021.3080677
Abstract
Communication protocols are the languages used by network nodes. Before a user equipment (UE) can exchange data with a base station (BS), it must first negotiate the conditions and parameters for that transmission. This negotiation is supported by signaling messages at all layers of the protocol stack. Each year, the mobile communications industry defines and standardizes these messages, which are designed by humans during lengthy technical (and often political) debates. Following this standardization effort, the development phase begins, wherein the industry interprets and implements the resulting standards. But is this massive development undertaking the only way to implement a given protocol? We address the question of whether radios can learn a pre-given target protocol as an intermediate step towards evolving their own. Furthermore, we train cellular radios to emerge a channel access policy that performs optimally under the constraints of the target protocol. We show that multi-agent reinforcement learning (MARL) and learning-to-communicate (L2C) techniques achieve this goal with gains over expert systems. Finally, we provide insight into the transferability of these results to scenarios never seen during training.
arXiv commentSubmitted for journal publication
References in corpus (7)
- Learning to Communicate with Deep Multi-Agent Reinforcement Learning
- A Survey and Critique of Multiagent Deep Reinforcement Learning
- Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
- Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
- Social Influence as Intrinsic Motivation for Multi-Agent Deep Reinforcement Learning
- Assessing Generalization in Deep Reinforcement Learning
- Learn to Schedule (LEASCH): A Deep reinforcement learning approach for radio resource scheduling in the 5G MAC layer