Deep reinforcement learning for RAN optimization and control
arXiv:2011.04607
Abstract
Due to the high variability of the traffic in the radio access network (RAN), fixed network configurations are not flexible enough to achieve optimal performance. Our vendors provide several settings of the eNodeB to optimize the RAN performance, such as media access control scheduler, loading balance, etc. But the detailed mechanisms of the eNodeB configurations are usually very complicated and not disclosed, not to mention the large key performance indicators (KPIs) space needed to be considered. These make constructing a simulator, offline tuning, or rule-based solutions difficult. We aim to build an intelligent controller without strong assumption or domain knowledge about the RAN and can run 24/7 without supervision. To achieve this goal, we first build a closed-loop control testbed RAN in a lab environment with one eNodeB provided by one of the largest wireless vendors and four smartphones. Next, we build a double Q network agent trained with the live feedback of the key performance indicators from the RAN. Our work proved the effectiveness of applying deep reinforcement learning to improve network performance in a real RAN network environment.
6 pages, 2 figures
References in corpus (12)
- Continuous control with deep reinforcement learning
- Prioritized Experience Replay
- IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures
- Deep Reinforcement Learning: An Overview
- Rainbow: Combining Improvements in Deep Reinforcement Learning
- Deep Q-learning from Demonstrations
- A Deep-Reinforcement Learning Approach for Software-Defined Networking Routing Optimization
- Learn to Schedule (LEASCH): A Deep reinforcement learning approach for radio resource scheduling in the 5G MAC layer
- SEED RL: Scalable and Efficient Deep-RL with Accelerated Central Inference
- Proactive Resource Management for LTE in Unlicensed Spectrum: A Deep Learning Perspective
- Cache-Enabled Dynamic Rate Allocation via Deep Self-Transfer Reinforcement Learning
- A Survey of Multimedia Streaming in LTE Cellular Networks