Intelligent Link Adaptation for Grant-Free Access Cellular Networks: A Distributed Deep Reinforcement Learning Approach
arXiv:2107.04145
Abstract
With the continuous growth of machine-type devices (MTDs), it is expected that massive machine-type communication (mMTC) will be the dominant form of traffic in future wireless networks. Applications based on this technology, have fundamentally different traffic characteristics from human-to-human (H2H) communication, which involves a relatively small number of devices transmitting large packets consistently. Conversely, in mMTC applications, a very large number of MTDs transmit small packets sporadically. Therefore, conventional grant-based access schemes commonly adopted for H2H service, are not suitable for mMTC, as they incur in a large overhead associated with the channel request procedure. We propose three grant-free distributed optimization architectures that are able to significantly minimize the average power consumption of the network. The problem of physical layer (PHY) and medium access control (MAC) optimization in grant-free random access transmission is is modeled as a partially observable stochastic game (POSG) aimed at minimizing the average transmit power under a per-device delay constraint. The results show that the proposed architectures are able to achieve significantly less average latency than a baseline, while spending less power. Moreover, the proposed architectures are more robust than the baseline, as they present less variance in the performance for different system realizations.
arXiv comment14 pages, 8 Figures
References in corpus (11)
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
- Trust Region Policy Optimization
- Learning to Communicate with Deep Multi-Agent Reinforcement Learning
- Massive Machine-type Communications in 5G: Physical and MAC-layer solutions
- Sparse Signal Processing for Grant-Free Massive Connectivity: A Future Paradigm for Random Access Protocols in the Internet of Things
- Counterfactual Multi-Agent Policy Gradients
- Stabilising Experience Replay for Deep Multi-Agent Reinforcement Learning
- Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability
- Fairness and Sum-Rate Maximization via Joint Channel and Power Allocation in Uplink SCMA Networks
- Modeling, Analysis, and Optimization of Grant-Free NOMA in Massive MTC via Stochastic Geometry
- Uplink Grant-Free Random Access Solutions for URLLC services in 5G New Radio