Closed-Form Delay-Optimal Power Control for Energy Harvesting Wireless System with Finite Energy Storage

Abstract

In this paper, we consider delay-optimal power control for an energy harvesting wireless system with finite energy storage. The wireless system is powered solely by a renewable energy source with bursty data arrivals, and is characterized by a data queue and an energy queue. We consider a delay-optimal power control problem and formulate an infinite horizon average cost Markov Decision Process (MDP). To deal with the curse of dimensionality, we introduce a virtual continuous time system and derive closed-form approximate priority functions for the discrete time MDP at various operating regimes. Based on the approximation, we obtain an online power control solution which is adaptive to the channel state information as well as the data and energy queue state information. The derived power control solution has a multi-level water-filling structure, where the water level is determined jointly by the data and energy queue lengths. We show through simulations that the proposed scheme has significant performance gain compared with various baselines.

arXiv comment17 pages, 9 figures, 1 table. Accepted for publication in IEEE Transactions on Signal Processing

References in corpus (7)

• Optimal Energy Management Policies for Energy Harvesting Sensor Nodes
• Broadcasting with an Energy Harvesting Rechargeable Transmitter
• A Learning Theoretic Approach to Energy Harvesting Communication System Optimization
• A Survey on Delay-Aware Resource Control for Wireless Systems --- Large Deviation Theory, Stochastic Lyapunov Drift and Distributed Stochastic Learning
• Wireless Compressive Sensing for Energy Harvesting Sensor Nodes
• Decentralized Delay Optimal Control for Interference Networks with Limited Renewable Energy Storage
• Closed-Form Delay-Optimal Power Control for Energy Harvesting Wireless System with Finite Energy Storage

Cited by in corpus (5)

• Energy Harvesting Wireless Sensor Networks: Delay Analysis Considering Energy Costs of Sensing and Transmission
• Closed-Form Delay-Optimal Power Control for Energy Harvesting Wireless System with Finite Energy Storage
• On the Tradeoff between Energy Harvesting and Caching in Wireless Networks
• Multi-Timescale Ensemble Q-learning for Markov Decision Process Policy Optimization
• Closed-Form Delay-Optimal Computation Offloading in Mobile Edge Computing Systems