Deep Reinforcement Learning for RIS-aided Multiuser Full-Duplex Secure Communications with Hardware Impairments
arXiv:2208.07820 · doi:10.1109/JIOT.2022.3177705
Abstract
In this paper, we investigate a reconfigurable intelligent surface (RIS)-aided multiuser full-duplex secure communication system with hardware impairments at transceivers and RIS, where multiple eavesdroppers overhear the two-way transmitted signals simultaneously, and an RIS is applied to enhance the secrecy performance. Aiming at maximizing the sum secrecy rate (SSR), a joint optimization problem of the transmit beamforming at the base station (BS) and the reflecting beamforming at the RIS is formulated under the transmit power constraint of the BS and the unit modulus constraint of the phase shifters. As the environment is time-varying and the system is high-dimensional, this non-convex optimization problem is mathematically intractable. A deep reinforcement learning (DRL)-based algorithm is explored to obtain the satisfactory solution by repeatedly interacting with and learning from the dynamic environment. Extensive simulation results illustrate that the DRL-based secure beamforming algorithm is proved to be significantly effective in improving the SSR. It is also found that the performance of the DRL-based method can be greatly improved and the convergence speed of neural network can be accelerated with appropriate neural network parameters.
arXiv comment16pages,14 figures, accepted by IEEE Internet of Things Journal
References in corpus (9)
- Addressing Function Approximation Error in Actor-Critic Methods
- Massive MIMO Systems with Non-Ideal Hardware: Energy Efficiency, Estimation, and Capacity Limits
- Intelligent Reflecting Surface-Enhanced OFDM: Channel Estimation and Reflection Optimization
- Artificial Intelligence-Enabled Intelligent 6G Networks
- Deep Reinforcement Learning Based Intelligent Reflecting Surface for Secure Wireless Communications
- Multiuser Full-Duplex Two-Way Communications via Intelligent Reflecting Surface
- Full-Duplex Bidirectional Secure Communications under Perfect and Distributionally Ambiguous Eavesdropper's CSI
- Ergodic Secrecy Rate of RIS-Assisted Communication Systems in the Presence of Discrete Phase Shifts and Multiple Eavesdroppers
- Achievable Rate Analysis and Phase Shift Optimization on Intelligent Reflecting Surface with Hardware Impairments