Intelligent Power Control for Spectrum Sharing in Cognitive Radios: A Deep Reinforcement Learning Approach

Abstract

We consider the problem of spectrum sharing in a cognitive radio system consisting of a primary user and a secondary user. The primary user and the secondary user work in a non-cooperative manner. Specifically, the primary user is assumed to update its transmit power based on a pre-defined power control policy. The secondary user does not have any knowledge about the primary user's transmit power, or its power control strategy. The objective of this paper is to develop a learning-based power control method for the secondary user in order to share the common spectrum with the primary user. To assist the secondary user, a set of sensor nodes are spatially deployed to collect the received signal strength information at different locations in the wireless environment. We develop a deep reinforcement learning-based method, which the secondary user can use to intelligently adjust its transmit power such that after a few rounds of interaction with the primary user, both users can transmit their own data successfully with required qualities of service. Our experimental results show that the secondary user can interact with the primary user efficiently to reach a goal state (defined as a state in which both users can successfully transmit their data) from any initial states within a few number of steps.

References in corpus (4)

• Adam: A Method for Stochastic Optimization
• Playing Atari with Deep Reinforcement Learning
• Two-sided Matching Based Cooperative Spectrum Sharing
• Sample Approximation-Based Deflation Approaches for Chance SINR Constrained Joint Power and Admission Control

Cited by in corpus (16)

• Machine Learning for Wireless Communications in the Internet of Things: A Comprehensive Survey
• Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
• Learning Decentralized Wireless Resource Allocations with Graph Neural Networks
• Deep Reinforcement Learning for Radio Resource Allocation and Management in Next Generation Heterogeneous Wireless Networks: A Survey
• Deep-Waveform: A Learned OFDM Receiver Based on Deep Complex-valued Convolutional Networks
• A Deep Q-Learning Method for Downlink Power Allocation in Multi-Cell Networks
• Deep Learning Enabled Optimization of Downlink Beamforming Under Per-Antenna Power Constraints: Algorithms and Experimental Demonstration
• A Context-aware Radio Resource Management in Heterogeneous Virtual RANs
• GAN-powered Deep Distributional Reinforcement Learning for Resource Management in Network Slicing
• Deep Reinforcement Learning based Modulation and Coding Scheme Selection in Cognitive Heterogeneous Networks
• Deep Learning for Radio Resource Allocation in Multi-Cell Networks
• Deep Reinforcement Learning for Distributed Uncoordinated Cognitive Radios Resource Allocation
• Green Deep Reinforcement Learning for Radio Resource Management: Architecture, Algorithm Compression and Challenge
• Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey
• Distributed Deep Reinforcement Learning for Collaborative Spectrum Sharing
• Dynamic Multichannel Access via Multi-agent Reinforcement Learning: Throughput and Fairness Guarantees