Dynamic Spectrum Access in Time-varying Environment: Distributed Learning Beyond Expectation Optimization
arXiv:1502.06672
Abstract
This article investigates the problem of dynamic spectrum access for canonical wireless networks, in which the channel states are time-varying. In the most existing work, the commonly used optimization objective is to maximize the expectation of a certain metric (e.g., throughput or achievable rate). However, it is realized that expectation alone is not enough since some applications are sensitive to fluctuations. Effective capacity is a promising metric for time-varying service process since it characterizes the packet delay violating probability (regarded as an important statistical QoS index), by taking into account not only the expectation but also other high-order statistic. Therefore, we formulate the interactions among the users in the time-varying environment as a non-cooperative game, in which the utility function is defined as the achieved effective capacity. We prove that it is an ordinal potential game which has at least one pure strategy Nash equilibrium. Based on an approximated utility function, we propose a multi-agent learning algorithm which is proved to achieve stable solutions with dynamic and incomplete information constraints. The convergence of the proposed learning algorithm is verified by simulation results. Also, it is shown that the proposed multi-agent learning algorithm achieves satisfactory performance.
arXiv comment13 pages, 10 figures, accepted for publication in IEEE Transactions on Communications
References in corpus (4)
- Distributed Learning in Multi-Armed Bandit with Multiple Players
- Coalitional Games in Partition Form for Joint Spectrum Sensing and Access in Cognitive Radio Networks
- Quality-Of-Service Provisioning in Decentralized Networks: A Satisfaction Equilibrium Approach
- A Game Theoretic Perspective on Self-organizing Optimization for Cognitive Small Cells