Contention Window Optimization in IEEE 802.11ax Networks with Deep Reinforcement Learning
arXiv:2003.01492 · doi:10.1109/WCNC49053.2021.9417575
Abstract
The proper setting of contention window (CW) values has a significant impact on the efficiency of Wi-Fi networks. Unfortunately, the standard method used by 802.11 networks is not scalable enough to maintain stable throughput for an increasing number of stations, yet it remains the default method of channel access for 802.11ax single-user transmissions. Therefore, we propose a new method of CW control, which leverages deep reinforcement learning (DRL) principles to learn the correct settings under different network conditions. Our method, called centralized contention window optimization with DRL (CCOD), supports two trainable control algorithms: deep Q-network (DQN) and deep deterministic policy gradient (DDPG). We demonstrate through simulations that it offers efficiency close to optimal (even in dynamic topologies) while keeping computational cost low.
arXiv comment6 pages, 6 figures, published in 2021 IEEE Wireless Communications and Networking Conference (WCNC)
References in corpus (5)
- Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
- Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
- Learn to Schedule (LEASCH): A Deep reinforcement learning approach for radio resource scheduling in the 5G MAC layer
- Control Theoretic Optimization of 802.11 WLANs: Implementation and Experimental Evaluation
- Learning to Wait: Wi-Fi Contention Control using Load-based Predictions