A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks

Abstract

Model-free learning has been considered as an efficient tool for designing control mechanisms when the model of the system environment or the interaction between the decision-making entities is not available as a-priori knowledge. With model-free learning, the decision-making entities adapt their behaviors based on the reinforcement from their interaction with the environment and are able to (implicitly) build the understanding of the system through trial-and-error mechanisms. Such characteristics of model-free learning is highly in accordance with the requirement of cognition-based intelligence for devices in cognitive wireless networks. Recently, model-free learning has been considered as one key implementation approach to adaptive, self-organized network control in cognitive wireless networks. In this paper, we provide a comprehensive survey on the applications of the state-of-the-art model-free learning mechanisms in cognitive wireless networks. According to the system models that those applications are based on, a systematic overview of the learning algorithms in the domains of single-agent system, multi-agent systems and multi-player games is provided. Furthermore, the applications of model-free learning to various problems in cognitive wireless networks are discussed with the focus on how the learning mechanisms help to provide the solutions to these problems and improve the network performance over the existing model-based, non-adaptive methods. Finally, a broad

Submitted to IEEE Communication Survey & Tutorial

References in corpus (4)

• Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications
• Accelerating Reinforcement Learning through Implicit Imitation
• Reinforcement Learning in POMDP's via Direct Gradient Ascent
• Power allocation with stackelberg game in femtocell networks: a self-learning approach

Cited by in corpus (11)

• Towards Massive Machine Type Communications in Ultra-Dense Cellular IoT Networks: Current Issues and Machine Learning-Assisted Solutions
• Reinforcement Learning for IoT Security: A Comprehensive Survey
• Game Theory for Multi-Access Edge Computing: Survey, Use Cases, and Future Trends
• Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
• Decentralized Learning for Optimality in Stochastic Dynamic Teams and Games with Local Control and Global State Information
• A Simple Reinforcement Learning Mechanism for Resource Allocation in LTE-A Networks with Markov Decision Process and Q-Learning
• Medium Access Control protocol for Collaborative Spectrum Learning in Wireless Networks
• Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications
• Spectrum Intelligent Radio: Technology, Development, and Future Trends
• Machine Learning for Heterogeneous Ultra-Dense Networks with Graphical Representations
• A Centralized Multi-stage Non-parametric Learning Algorithm for Opportunistic Spectrum Access