Deep Reinforcement Learning Based Intelligent Reflecting Surface for Secure Wireless Communications

Abstract

In this paper, we study an intelligent reflecting surface (IRS)-aided wireless secure communication system for physical layer security, where an IRS is deployed to adjust its surface reflecting elements to guarantee secure communication of multiple legitimate users in the presence of multiple eavesdroppers. Aiming to improve the system secrecy rate, a design problem for jointly optimizing the base station (BS)'s beamforming and the IRS's reflecting beamforming is formulated given the different quality of service (QoS) requirements and time-varying channel condition. As the system is highly dynamic and complex, and it is challenging to address the non-convex optimization problem, a novel deep reinforcement learning (DRL)-based secure beamforming approach is firstly proposed to achieve the optimal beamforming policy against eavesdroppers in dynamic environments. Furthermore, post-decision state (PDS) and prioritized experience replay (PER) schemes are utilized to enhance the learning efficiency and secrecy performance. Specifically, PDS is capable of tracing the environment dynamic characteristics and adjust the beamforming policy accordingly. Simulation results demonstrate that the proposed deep PDS-PER learning-based secure beamforming approach can significantly improve the system secrecy rate and QoS satisfaction probability in IRS-aided secure communication systems.

This paper appears in IEEE Transactions on Wireless Communications

References in corpus (1)

• Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination

Cited by in corpus (16)

• An Overview of Signal Processing Techniques for RIS/IRS-aided Wireless Systems
• Deep Residual Learning for Channel Estimation in Intelligent Reflecting Surface-Assisted Multi-User Communications
• Reconfigurable Intelligent Surface for Physical Layer Security in 6G-IoT: Designs, Issues, and Advances
• Proximal Policy Optimization-based Transmit Beamforming and Phase-shift Design in an IRS-aided ISAC System for the THz Band
• Interplay between RIS and AI in Wireless Communications: Fundamentals, Architectures, Applications, and Open Research Problems
• Deep Reinforcement Learning for RIS-aided Multiuser Full-Duplex Secure Communications with Hardware Impairments
• Security in Energy Harvesting Networks: A Survey of Current Solutions and Research Challenges
• Intelligent Reflecting Surface based Passive Information Transmission: A Symbol-Level Precoding Approach
• Federated Deep Reinforcement Learning for RIS-Assisted Indoor Multi-Robot Communication Systems
• Learning-based Intelligent Surface Configuration, User Selection, Channel Allocation, and Modulation Adaptation for Jamming-resisting Multiuser OFDMA Systems
• Deep Contextual Bandit and Reinforcement Learning for IRS-Assisted MU-MIMO Systems
• IRS-User Association in IRS-Aided MISO Wireless Networks: Convex Optimization and Machine Learning Approaches
• Physical Layer Security for Integrated Sensing and Communication: A Survey
• Secrecy Rate Maximization in Multi-IRS Millimeter Wave Networks
• Downlink Power Minimization in Intelligent Reconfigurable Surface-Aided Security Classification Wireless Communications System
• Machine Learning Empowered Resource Allocation in IRS Aided MISO-NOMA Networks