157 citations · 473 across the 49 of their papers we have counts for
7 papers · 1 filter
Joint Sensing and Communications for Deep Reinforcement Learning-based Beam Management in 6G
Yujie Yao, Hao Zhou, Melike Erol-Kantarci
User location is a piece of critical information for network management and control. However, location uncertainty is unavoidable in certain settings leading to localization errors…
Deep Reinforcement Learning-based Radio Resource Allocation and Beam Management under Location Uncertainty in 5G mmWave Networks
Yujie Yao, Hao Zhou, Melike Erol-Kantarci
Millimeter Wave (mmWave) is an important part of 5G new radio (NR), in which highly directional beams are adapted to compensate for the substantial propagation loss based on UE loc…
Multi-agent Bayesian Deep Reinforcement Learning for Microgrid Energy Management under Communication Failures
Hao Zhou, Atakan Aral, Ivona Brandic +1
Microgrids (MGs) are important players for the future transactive energy systems where a number of intelligent Internet of Things (IoT) devices interact for energy management in th…
Smart Home Energy Management: Sequence-to-Sequence Load Forecasting and Q-Learning
Mina Razghandi, Hao Zhou, Melike Erol-Kantarci +1
A smart home energy management system (HEMS) can contribute towards reducing the energy costs of customers; however, HEMS suffers from uncertainty in both energy generation and con…
Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing
Hao Zhou, Melike Erol-Kantarci, Vincent Poor
Network slicing is a critical technique for 5G communications that covers radio access network (RAN), edge, transport and core slicing.The evolving network architecture requires th…
Decentralized Microgrid Energy Management: A Multi-agent Correlated Q-learning Approach
Hao Zhou, Melike Erol-Kantarci
Microgrids (MG) are anticipated to be important players in the future smart grid. For proper operation of MGs an Energy Management System (EMS) is essential. The EMS of an MG could…
Correlated Deep Q-learning based Microgrid Energy Management
Hao Zhou, Melike Erol-Kantarci
Microgrid (MG) energy management is an important part of MG operation. Various entities are generally involved in the energy management of an MG, e.g., energy storage system (ESS),…