activity
20212025
most citedCorrelated Deep Q-learning based Microgrid Energy Management

14 citations · 47 across the 17 of their papers we have counts for

collaborators

17 papers

cs.LG2025

Intelligent Attacks and Defense Methods in Federated Learning-enabled Energy-Efficient Wireless Networks

Han Zhang, Hao Zhou, Medhat Elsayed +4

Federated learning (FL) is a promising technique for learning-based functions in wireless networks, thanks to its distributed implementation capability. On the other hand, distribu…

cs.NI2024★ 6 cited

Smart Jamming Attack and Mitigation on Deep Transfer Reinforcement Learning Enabled Resource Allocation for Network Slicing

Shavbo Salehi, Hao Zhou, Medhat Elsayed +4

Network slicing is a pivotal paradigm in wireless networks enabling customized services to users and applications. Yet, intelligent jamming attacks threaten the performance of netw…

cs.NI2024

Machine Learning-enabled Traffic Steering in O-RAN: A Case Study on Hierarchical Learning Approach

Md Arafat Habib, Hao Zhou, Pedro Enrique Iturria-Rivera +5

Traffic Steering is a crucial technology for wireless networks, and multiple efforts have been put into developing efficient Machine Learning (ML)-enabled traffic steering schemes…

cs.NI2023

Distributed Attacks over Federated Reinforcement Learning-enabled Cell Sleep Control

Han Zhang, Hao Zhou, Medhat Elsayed +4

Federated learning (FL) is particularly useful in wireless networks due to its distributed implementation and privacy-preserving features. However, as a distributed learning system…

cs.NI2023

Intent-driven Intelligent Control and Orchestration in O-RAN Via Hierarchical Reinforcement Learning

Md Arafat Habib, Hao Zhou, Pedro Enrique Iturria-Rivera +5

rApps and xApps need to be controlled and orchestrated well in the open radio access network (O-RAN) so that they can deliver a guaranteed network performance in a complex multi-ve…

cs.NI2023★ 1 cited

Heuristic Algorithms for RIS-assisted Wireless Networks: Exploring Heuristic-aided Machine Learning

Hao Zhou, Melike Erol-Kantarci, Yuanwei Liu +1

Reconfigurable intelligent surfaces (RISs) are a promising technology to enable smart radio environments. However, integrating RISs into wireless networks also leads to substantial…

cs.LG2023★ 4 cited

Smart Home Energy Management: VAE-GAN synthetic dataset generator and Q-learning

Mina Razghandi, Hao Zhou, Melike Erol-Kantarci +1

Recent years have noticed an increasing interest among academia and industry towards analyzing the electrical consumption of residential buildings and employing smart home energy m…

eess.SY2023★ 2 cited

Cooperative Hierarchical Deep Reinforcement Learning based Joint Sleep and Power Control in RIS-aided Energy-Efficient RAN

Hao Zhou, Medhat Elsayed, Majid Bavand +3

Energy efficiency (EE) is one of the most important metrics for envisioned 6G networks, and sleep control, as a cost-efficient approach, can significantly lower power consumption b…

cs.NI2023★ 1 cited

On-Device Intelligence for 5G RAN: Knowledge Transfer and Federated Learning enabled UE-Centric Traffic Steering

Han Zhang, Hao Zhou, Medhat Elsayed +4

Traffic steering (TS) is a promising approach to support various service requirements and enhance transmission reliability by distributing network traffic loads to appropriate base…

eess.SP2023★ 2 cited

A Survey on Model-based, Heuristic, and Machine Learning Optimization Approaches in RIS-aided Wireless Networks

Hao Zhou, Melike Erol-Kantarci, Yuanwei Liu +1

Reconfigurable intelligent surfaces (RISs) have received considerable attention as a key enabler for envisioned 6G networks, for the purpose of improving the network capacity, cove…

eess.SP2023

Beam Selection for Energy-Efficient mmWave Network Using Advantage Actor Critic Learning

Ycaro Dantas, Pedro Enrique Iturria-Rivera, Hao Zhou +4

The growing adoption of mmWave frequency bands to realize the full potential of 5G, turns beamforming into a key enabler for current and next-generation wireless technologies. Many…

cs.NI2023★ 1 cited

Hierarchical Reinforcement Learning Based Traffic Steering in Multi-RAT 5G Deployments

Md Arafat Habib, Hao Zhou, Pedro Enrique Iturria-Rivera +5

In 5G non-standalone mode, an intelligent traffic steering mechanism can vastly aid in ensuring smooth user experience by selecting the best radio access technology (RAT) from a mu…

eess.SP2023

Hierarchical Reinforcement Learning for RIS-Assisted Energy-Efficient RAN

Hao Zhou, Long Kong, Medhat Elsayed +4

Reconfigurable intelligent surface (RIS) is emerging as a promising technology to boost the energy efficiency (EE) of 5G beyond and 6G networks. Inspired by this potential, in this…

cs.NI2022★ 1 cited

Knowledge Transfer and Reuse: A Case Study of AI-enabled Resource Management in RAN Slicing

Hao Zhou, Melike Erol-Kantarci, Vincent Poor

An efficient resource management scheme is critical to enable network slicing in 5G networks and in envisioned 6G networks, and artificial intelligence (AI) techniques offer promis…

cs.NI2021★ 3 cited

RAN Resource Slicing in 5G Using Multi-Agent Correlated Q-Learning

Hao Zhou, Medhat Elsayed, Melike Erol-Kantarci

5G is regarded as a revolutionary mobile network, which is expected to satisfy a vast number of novel services, ranging from remote health care to smart cities. However, heterogene…

eess.SY2021★ 12 cited

Decentralized Microgrid Energy Management: A Multi-agent Correlated Q-learning Approach

Hao Zhou, Melike Erol-Kantarci

Microgrids (MG) are anticipated to be important players in the future smart grid. For proper operation of MGs an Energy Management System (EMS) is essential. The EMS of an MG could…

eess.SY2021★ 14 cited

Correlated Deep Q-learning based Microgrid Energy Management

Hao Zhou, Melike Erol-Kantarci

Microgrid (MG) energy management is an important part of MG operation. Various entities are generally involved in the energy management of an MG, e.g., energy storage system (ESS),…