Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Abstract

The fifth generation of wireless communications (5G) promises massive increases in traffic volume and data rates, as well as improved reliability in voice calls. Jointly optimizing beamforming, power control, and interference coordination in a 5G wireless network to enhance the communication performance to end users poses a significant challenge. In this paper, we formulate the joint design of beamforming, power control, and interference coordination as a non-convex optimization problem to maximize the signal to interference plus noise ratio (SINR) and solve this problem using deep reinforcement learning. By using the greedy nature of deep Q-learning to estimate future rewards of actions and using the reported coordinates of the users served by the network, we propose an algorithm for voice bearers and data bearers in sub-6 GHz and millimeter wave (mmWave) frequency bands, respectively. The algorithm improves the performance measured by SINR and sum-rate capacity. In realistic cellular environments, the simulation results show that our algorithm outperforms the link adaptation industry standards for sub-6 GHz voice bearers. For data bearers in the mmWave frequency band, our algorithm approaches the maximum sum-rate capacity, but with less than 4% of the required run time.

(c) 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

References in corpus (11)

• Playing Atari with Deep Reinforcement Learning
• An Overview of Signal Processing Techniques for Millimeter Wave MIMO Systems
• Channel Estimation and Hybrid Precoding for Millimeter Wave Cellular Systems
• Millimeter Wave Wireless Communications: New Results for Rural Connectivity
• A Deep Learning Framework for Optimization of MISO Downlink Beamforming
• A Framework for Automated Cellular Network Tuning with Reinforcement Learning
• Partially Blind Handovers for mmWave New Radio Aided by Sub-6 GHz LTE Signaling
• Deep Learning in Downlink Coordinated Multipoint in New Radio Heterogeneous Networks
• Q-Learning Algorithm for VoLTE Closed-Loop Power Control in Indoor Small Cells
• Directional Radio Propagation Path Loss Models for Millimeter-Wave Wireless Networks in the 28-, 60-, and 73-GHz Bands
• Deep Learning Based Online Power Control for Large Energy Harvesting Networks

Cited by in corpus (19)

• Deep Reinforcement Learning Based Intelligent Reflecting Surface for Secure Wireless Communications
• Proximal Policy Optimization-based Transmit Beamforming and Phase-shift Design in an IRS-aided ISAC System for the THz Band
• Scoring the Terabit/s Goal:Broadband Connectivity in 6G
• Hierarchical Multi-Agent DRL-Based Framework for Joint Multi-RAT Assignment and Dynamic Resource Allocation in Next-Generation HetNets
• True-data Testbed for 5G/B5G Intelligent Network
• Radio Resource and Beam Management in 5G mmWave Using Clustering and Deep Reinforcement Learning
• Multi-hop RIS-Empowered Terahertz Communications: A DRL-based Hybrid Beamforming Design
• Adversarial Machine Learning for 5G Communications Security
• ViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutions
• Enabling Feedback-Free MIMO Transmission for FD-RAN: A Data-driven Approach
• Intelligent Radio Signal Processing: A Survey
• Deep Reinforcement Learning for Multi-Agent Power Control in Heterogeneous Networks
• Millimeter Wave Communications on Overhead Messenger Wire: Deep Reinforcement Learning-Based Predictive Beam Tracking
• Machine Learning-Enabled Joint Antenna Selection and Precoding Design: From Offline Complexity to Online Performance
• A Glimpse of Physical Layer Decision Mechanisms: Facts, Challenges, and Remedies
• Zero-Shot Adaptation for mmWave Beam-Tracking on Overhead Messenger Wires through Robust Adversarial Reinforcement Learning
• Deep Learning Assisted Calibrated Beam Training for Millimeter-Wave Communication Systems
• UAV-assisted Online Machine Learning over Multi-Tiered Networks: A Hierarchical Nested Personalized Federated Learning Approach
• Multi-Agent Double Deep Q-Learning for Beamforming in mmWave MIMO Networks